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Advanced  surveillance  and  weapon  guidance  systems  using  new 
mosaic  sensor  arrays  and  large  scale  integration  (LSI)  electronic 
data  processors  on  the  same  focal  plane  require  detection  of  weak 
targets  deeply  buried  in  background  clutter  noise  by  many  tens  of 
db's.  This  investigation  reports  on  the  focal  plane  processing 
techniques  to  accomplish  these  heretofore  unachievable  goals. 

Five  focal  plane  processing  algorithms  are  developed  consistin; 
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of  nonrecursive  statistical  spatial-temporal  filters  for  clutter 
suppression  followed  by  thresholding  for  initialization  of  targe 
detection.  These  filters  are  based  on  either  the  minimization  o 
mean  square  error  criterion  (for  MMSE  filters)  or  the  maximiza- 
tion of  signal  to  noise  ratio  criterion  (for  matched  filters). 
Two  are  nonadaptive  spatial  filters  and  two  are  nonadaptive 
*P**i*l" temporal  filters.  The  fifth  type  is  an  adaptive  spatial 
filter  based  on  the  minimization  of  mean  square  error  criterion. 

These  filters  have  been  investigated  analytically  and  by 
computer  simulation  using  computer  generated  images  containing 
correlated  clutter  noises  modeled  by  Markov  processes  and  also 
real  world  infrared  images.  Using  an  infrared  image  in  the  red 
spike  spectral  band,  a single  frame  statistical  spatial  filter 
can  suppress  the  clutter  by  27  db.  A five  frame  sequential 
statistical  spatial- temporal  filter  was  found  to  have  a clutter 
suppression  of  87  db. 
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ABSTRACT 

Advanced  surveillance  and  weapon  guidance  systems  using 
new  mosaic  sensor  arrays  and  large  scale  integration  (LSI) 
electronic  data  processors  on  the  same  focal  plane  require 
detection  of  weak  targets  deeply  buried  in  background  clutter 
noise  by  many  tens  of  db's.  This  investigation  reports  on 
the  focal  plane  processing  techniques  to  accomplish  these 
heretofore  unachievable  goals. 

Five  focal  plane  processing  algorithms  are  developed  con- 
sisting of  nonrecursive  statistical  spatial- temporal  filters 
for  clutter  suppression  followed  by  thresholding  for  initial- 
ization of  target  detection.  These  filters  are  based  on  either 
the  minimization  of  mean  square  error  criterion  (for  MMSE 
filters)  or  the  maximization  of  signal  to  noise  ratio  cri- 
terion (for  matched  filters) . Two  are  nonadaptive  spatial 
filters  and  two  are  nonadaptive  spatial- temporal  filters. 

The  fifth  type  is  an  adaptive  spatial  filter  based  on  the 
minimization  of  mean  square  error  criterion. 

These  filters  have  been  investigated  analytically  and  by 
computer  simulation  using  computer  generated  images  contain- 
ing correlated  clutter  noises  modeled  by  Markov  processes  and 
also  real  world  infrared  images.  Using  an  infrared  image  in 
the  red  spike  spectral  band,  a single  frame  statistical 
spatial  filter  can  suppress  the  clutter  by  27  db.  A five 
frame  sequential  statistical  spatial- temporal  filter  was 
found  to  have  a clutter  suppression  of  87  db. 
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The  enormous  impact  of  integrated  circuit  technologies  on 


baseband  electronics  is  well  known.  Revolutionary  advances 
of  LSI  (large  scale  integration)  and  VLSI  (very  large  scale 
integration)  devices  are  making  high  performance  computer  and 
signal  processing  capabilities  available  at  lower  cost  with 
lighter  weight,  less  power  consumption  and  higher  reliability. 
Their  impact  on  military  systems  will  be  tremendous  and  far- 
reaching. 

In  recent  years,  IC  technologies  have  also  been  making 
important  changes  in  high  frequency  electronics  throughout 
the  microwave  and  optical  bands.  In  optical  detection  tech- 
nologies, thousands  and  hundreds  of  thousands  of  optical  and 
infrared  detectors  can  be  made  in  the  not  too  distant  future 
on  one  chip  by  IC  batch  processing  in  the  form  of  what  is 
generally  known  as  "mosaic  detector  array"  or  "mosaic  focal 
plane  array"  [1].  The  availability  of  such  a large  number 
of  detectors  on  the  same  focal  plane  has  inspired  new  modes 
of  optical  detection,  such  as  the  time-delayed- integration 
scanning  [2],  staring  [3],  and  step-staring  [3J  modes  which 
offer  better  detection  performance.  Combined  with  LSI  com- 
puters or  signal  processors  on  the  same  focal  plane,  complex 
tasks  can  now  be  carried  out  at  or  near  the  focal  plane  by 
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what  are  called  "smart  sensors."1  This  equipment  is  intelligent, 
small,  light,  comsumes  little  power  and  is  not  expensive.  It 
is  certain  that  these  smart  sensors  are  going  to  make  signif- 
icant improvements  to  man/  surveillance,  reconnaissance  and 
guidance  s/stems. 

This  thesis  deals  with  an  image  processing,  or  more 
specifically,  a "focal  plane  processing"  problem  which  is 
created  by  these  new  "mosaic  focal  plane"  and  "smart  sensor" 
developments.  It  will  be  explained  in  the  next  section. 

B.  REQUIREMENTS  OF  NEW  FOCAL  PLANE  PROCESSING 

With  the  new-found  computing  and  signal  processing  capa- 
bilities which  will  be  mounted  next  to  the  detector  array  in 
the  near  future,  very  ambitious  focal  plane  processing  objec- 
tives have  been  formulated.  In  front  of  the  mosaic  detector 
array,  computer  controlled  adaptive  optics  and  programmable 
optical  filters  are  being  developed.  On  the  mosaic  detector 
focal  plane,  sophisticated  "on  chip"  signal  processing  oper- 
ations such  as  time-delayed  integration  [2],  a.c.  coupling  [4], 
differentiation  [5],  multiplexing  [6],  convolutional  read-out 
and  others  are  being  investigated.  After,  or  during,  the 
read-out,  image  processing  operations  of  sampled  analog  signals 
can  be  carried  out.  If  digital  focal  plane  processing  is  used, 
signal  formating,  sample  and  hold  and  analog  to  digital 
conversion  must  be  performed, 

1 "Smart  sensors"  session  in  SPIE  1979  East  Symposium  to 
be  held  in  Washington,  D.C.  April  17-18,  1979. 
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For  military  applications  of  surveillance,  reconnaissance 
and  guidance,  focal  plane  processing  objectives  include  the 
basic  signal  manipulations  described  above  and  other  predetec- 
tion steps,  such  as  background  clutter  suppression,  target 
enhancement  and  thresholding  for  initialization  of  target 
detection.  Following  this,  there  are  many  post-thresholding 
focal  plane  processing  steps  such  as  target  linking,  track- 
ing, track  assembly,  track  association,  trajectory  estimation, 
target  discrimination,  target  recognition,  and  many  others. 

This  thesi?  is  concerned  with  the  predetection  steps  of 
background  clutter  suppression  and  thresholding  for  initial- 
ization of  target  detection. 

In  visible  imaging  systems,  the  contrast  between  targets 
and  background  is  usually  high.  The  target  signal  to  noise 
ratio  is  often  quite  adequate.  Therefore,  focal  plane  process- 
ing operations  of  visible  images  can  directly  deal  with  target 
signals  and  background  noise  in  most  cases  without  any  pre- 
processing to  improve  the  signal  to  noise  ratio.  However, 
in  infrared  imaging  systems,  the  contrasts  between  targets 
and  backgrounds  are  much  smaller.  Target  signals  are  often 
a very  small  fraction  of  the  incoming  signal  which  consists 
of  a large  amount  of  background  clutter  noise  and  other  white 
noise.  All  infrared  imaging  systems  must  deal  with  the 
clutter  problem.  The  need  of  suppressing  background  clutter 
and  detecting  targets  buried  in  clutter  certainly  is  not  unique 
in  these  new  mosaic  focal  plane  arrays.  However,  the 


requirements  of  clutter  suppression  and  target  detection  are 
now  much  more  demanding  because  of  the  improved  performance 
of  mosaic  focal  plane  sensors  processors  and  much  more 
ambitious  system  goals.  In  new  surveillance  and  guidance 
systems,  it  is  sometimes  required  to  detect  weak  targets 
deeply  buried  in  clutter  by  many  ten's  of  db's.  Old  pro- 
cessing techniques  used  to  separate  targets  from  clutter  are 
simply  not  adequate  to  meet  these  requirements.  New  process- 
ing techniques  using  spatial,  temporal  and  spectral  character- 
istics of  both  the  targets  and  clutter  must  be  developed. 

These  techniques  are  different  from  most  of  the  well  known 
image  processing  techniques  in  two  major  aspects: 

0 They  deal  with  image  signals  of  very  low  signal  to 
noise  ratio.  Furthermore,  the  dominant  noise  com- 
ponent is  due  to  clutter  and  is  correlated  rather 
than  white. 

0 The  signals  of  interest  are  usually  point  targets, 
line  targets  and  targets  of  different  shapes  instead 
of  pictorial  details  of  the  image. 

Therefore,  they  are  called  "focal  plane  processing"  in  this 
thesis  instead  of  the  widely  used  name  of  "image  processing" 
which  usually  concerns  pictures,  photographs,  TV  pictures, 
etc. 

C.  FOCAL  PLANE  PROCESSING  TECHNIQUES  FOR  BACKGROUND 

CLUTTER  SUPPRESSION  AND  TARGET  DETECTION 

Clutter  suppression  and  target  detection  are  not  unique 
problems  for  mosaic  focal  plane  processing.  Similar  types 
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of  problems  exist  in  radar  and  sonar  processing  and  have  been 
extensively  investigated  [7,8].  Effective  processing  algor- 
ithms for  clutter  suppression  and  thresholding  for  target 
detection  have  been  well  developed.  However,  there  are  sig- 
nificant differences  between  mosaic  focal  plane  systems  and 
radar  and  sonar  systems  so  that  most  of  the  developed  process- 
ing algorithms  either  are  not  applicable  or  must  be  modified 
if  they  are  to  be  used  for  imaging  systems.  The  major  dif- 
ferences are  the  following: 

1.  Imaging  systems  are  mostly  passive.  Therefore, 
processing  algorithms  based  on  Doppler  shift  or  the  signal 
waveform  cannot  be  applied  to  passive  optical  systems. 

2.  Image  signals  are  three  dimensional,  which  includes 
two  dimensional  spatial  variations  on  a single  image  frame 
and  one  dimensional  temporal  variations  on  several  frames  of 
images.  Radar  and  sonar  signals  are  mostly  one  dimensional 
with  temporal  variations.  Therefore,  radar  and  sonar  pro- 
cessing algorithms  must  be  modified  if  they  are  applicable 
to  mosaic  focal  plane  problems. 

In  spite  of  these  differences,  the  concepts  of  most  signal 
processing  approaches  can  be  applied  to  the  new  problems.  In 
the  following,  several  processing  approaches  for  target 
enhancement  and  detection  are  listed. 

When  signal  to  noise  ratio  is  above  unity,  thresholding 
can  be  applied  to  separate  true  targets  from  background  noise. 
The  threshold  level  can  be  determined  from  several  different 
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considerations;  for  example,  based  on  a constant  false  alarm 
rate  (CFAR) , or  on  a given  probability  of  detection,  or  on  a 
given  probability  of  tracking,  etc. 

If  the  signal  to  noise  ratio  is  low,  as  in  many  practical 
situations,  prethresholding  signal  processing  steps  must  be 
employed  to  suppress  the  noise  and  enhance  the  target,  if 
possible,  so  that  the  signal  to  noise  ratio  will  be  adequate 
for  thresholding.  Seme  of  these  processing  approaches  are 
based  on  the  following  concepts: 

Summing  - Time  integration 
Differencing  - pulse  canceller 
Filtering : 

Based  on  time  domain  knowledge  - correlator 

Based  on  frequency  domain  knowledge  - frequency 
domain  filter 


Other  approaches  are  statistical,  based  on  the  following 
procedures : 

Statistical  processing: 

Maximization  of  signal  to  noise  ratio  - statistical 
matched  filter 

Minimization  of  mean  square  error 
Kalman  filter 

Wiener  filter,  MMSE  filter 
Maximization  of  likelihood  filter 

The  principles  of  some  of  these  signal  processing  approaches 
have  been  extended  and  applied  to  the  focal  plane  processing 
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problems  by  other  investigators  for  background  clutter  sup- 
pression. Some  are  deterministic  processing,  based  on  the 
following  concepts: 

Deterministically  Designed  Focal  Plane  Processing: 

Single  frame  processing  - Spatial  filters: 

Masking  - First  order.  Second  order  (Laplacian) , 
Fourth  order  [9] 

Summing  - Time-delayed  integration  [2] 

Multiple  frame  processing  - Temporal  filters: 

Summing  - Multiple  frame  integration 

Differencing  - Frame  to  frame  differencing,  Non- 
recursive Second  differencing,  Third 
differencing,  etc.  [10] 

Filtering  - Recursive  digital  high  pass  filters 
based  on  the  knowledge  of  frequency 
characteristics  of  the  clutter  [11] 
Active  band  pass  filters. 

Several  statistically  designed  processing  approaches  have 
also  been  investigated. 

Statistically  Designed  Focal  Plane  Processing: 

Single  frame  processing: 

Spatial  Kalman  filter  [12,13] 

Spatial  MMSE  filter  [14] 

Multiple  frame  processing  - Temporal  filter 
Maximum  likelihood  filter  [IS] 

Although  quite  a few  processing  algorithms  are  listed  above, 
only  the  deterministic  single  frame  spatial  filters  and  the 
multiple  frame  differencing  filters  have  been  substantially 
developed.  All  other  processing  approaches  have  only  received 
preliminary  investigation.  None  of  these  filters  have  shown 
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enough  clutter  suppression  capabilities  to  enable  detection 
of  weak  targets  more  than  70  db  below  clutter. 

D.  FOCAL  PLANE  PROCESSING  TECHNIQUES 

DEVELOPED  IN  THIS  THESIS 

The  objective  of  this  thesis  investigation  was  to  develop 
statistical  processing  algorithms  for  background  clutter 
suppression.  This  is  accomplished  in  several  phases.  First, 
design  procedures  are  developed  for  two  types  of  nonrecursive 
spatial  filters.  These  concepts  are  then  extended  to  three 
dimensions  by  adding  a temporal  filter.  Several  aspects  of 
target  detection  are  also  addressed,  with  special  considera- 
tion given  to  cases  involving  non-Gaussian  probability 
densities.  Adaptive  filter  algorithms  are  also  developed 
for  situations  involving  unknown  and  non-stationary  statistics 
of  background  clutter  noise.  Analytical  results  and  computer 
simulation  studies  demonstrate  the  feasibility  of  the  filter 
algorithms  proposed.  The  following  paragraphs  describe  in 
more  detail  the  development  of  the  processing  techniques. 

In  Chapter  II  the  basic  structure  of  nonrecursive  spatial 
and/or  temporal  filters  is  introduced.  The  spatial  filters, 
which  may  be  adaptive,  utilize  image  signals  in  the  neighbor- 
hood of  the  ’’estimation  pixel"  to  suppress  clutter  and  enhance 
target  intensity  at  the  estimation  pixel.  Further  improvement 
is  obtained  by  also  processing  spatially  filtered  data  from 
adjacent  image  frames. 


Expressions  fox  the  filter  coefficients  are  derived  in 
Chapter  III  for  two  criteria  which  have  been  previously  used 
in  one- dimensional  statistical  processing  filters  [16] : min- 
imization of  mean  square  error  (MMSE)  and  maximization  of 
output  signal  to  noise  ratio  [matched  filter) . Statistical 
nonrecursive  spatial  filters  based  on  the  MMSE  criterion  have 
been  studied  before  for  image  restoration  and  for  improvement 
of  signal  to  noise  ratio  against  white  noise  [23-25].  The 

design  of  these  filters,  however,  is  carried  out  using  spatial 

■ 

frequency  domain  techniques,  or  equivalent.  Such  filters  have 
not  been  very  useful  in  practical  applications  because  of  the 
large  size,  e.g.,  larger  than  10x10,  required  to  achieve 
meaningful  improvement  [25].  Furthermore,  a nonrecursive 

■\ 

spatial  filter  tends  to  blur  the  edges  of  an  object  [17] . The 
concept  of  using  nonrecursive  statistical  spatial  filters  for 
suppression  of  correlated  noise  was  originated  by  Bar  Yehoshua 
[14]  who  developed  a design  procedure  in  the  spatial  domain 
using  the  MMSE  criterion.  Bar  Yehoshua  developed  the  special 
application  of  statistical  nonrecursive  spatial  filters  for 
enhancement  of  point/line  target  signal  to  noise  ratio  in  the 
presence  of  spatially  correlated  noise.  He  showed  that  spa- 
tial filters  as  small  as  3 x 3 pixels  are  effective  in  the 
suppression  of  spatially  correlated  noise.  Furthermore,  his 
design  procedure  in  the  spatial  domain  is  well  suited  for  hard- 
ware implementation  because  the  rather  complex  two  dimensional 
transformation  operations  required  in  spatial  frequency 


domain  design  procedures  are  unnecessary.  Chapter  III  reviews 
Bar  Yehoshua's  work  and  extends  the  concept  to  nonrecursive 
spatial  matched  filters.  Other  related  work  is  contained  in 
[17].  The  matched  filter  for  the  enhancement  of  point  and 
line  targets  described  here  is  applicable  to  correlated,  as 
well  as  white,  noise.  In  addition,  a new  explicit  design 
procedure  is  presented.  This  thesis  extends  Bar  Yehoshua's 
concept  in  three  directions.  In  this  chapter,  a different 
design  criterion  based  on  the  maximization  of  signal  to  noise 
ratio  is  developed  for  the  second  type  of  nonrecursive  spatial 
filter--matched  filter.  Again,  spatial  matched  filters  are 
not  new  [17,18].  The  contribution  of  this  study  is  in  the 
development  of  its  new  application  to  the  enhancement  of  point/ 
line  target  to  noise  ratio  in  two  dimensional  and  three  dimen- 
sional images  of  very  low  signal  to  noise  ratio,  and  in  the 
design  procedure  in  spatial  and  temporal  domains  instead  of 
the  spatial  frequency  and  temporal  frequency  used  by  most 
other  workers.  Extensions  in  two  other  directions  will  be 
described  in  Chapter  IV  and  Chapter  VII. 

In  Chapter  IV,  two  nonadaptive  multiple  frame  processing 
approaches  for  clutter  suppression  are  developed.  They  are 
the  nonrecursive  sequential  spatial- temporal  filters  designed 
again  by  two  statistical  criteria  similar  to  those  in  Chapter 
III  which  lead  to  the  spatial-temporal  MMSE  filters  and  the 
spatial- temporal  matched  filters/  Temporal  filters  which 
use  several  frames  of  image  designed  by  either  deterministic 


or  statistical  information  are  not  new  [17].  However,  the 
combinations  of  spatial  and  temporal  filters  using  statistical 
information  of  several  frames  of  image  for  achieving  sub* 
stantial  enhancement  of  signal  to  noise  ratio  has  not  been 
reported  before.  This  thesis  investigates  a special  type  of 
multiple  frame  processing  consisting  of  sequential  applica- 
tion of  a spatial  filter  followed  by  a temporal  filter  using 
several  frames.  It  is  shown  analytically  that  the  clutter 
suppression  of  the  spatial  filter  and  of  the  temporal  filter 
are  multiplicative  (or  additive,  if  they  are  expressed  in 
terms  of  db) . 

In  Chapter  V,  the  thresholding  problem  for  initialization 
of  target  detection  is  investigated.  The  concept  of  thresh- 
olding for  detection  has  been  well  developed  for  radar 
systems  [8].  The  extension  of  the  thresholding  operation  to 
two  dimensional  problems  has  not  been  extensively  investigated  for 
cases  where  the  probability  density  functions  are  not  Gaussian. 
In  this  chapter,  a procedure  for  setting  the  threshold  based 
on  the  assumption  of  a Gaussian  distribution  is  applied  to 
computer  generated  images  whose  probability  density  functions 
are  Gaussian.  In  addition,  a new  procedure  for  setting 
threshold  level  based  on  a constant  false  alarm  rate  criterion 
without  the  assumption  of  a Gaussian  probability  density 


function  is  also  developed. 


In  Chapter  VI,  the  four  nonadaptive  statistical  filters 
developed  for  clutter  suppression  are  combined  with  thresh- 
olding as  the  nonadaptive  focal  plane  processing  algorithm 
studied  in  this  thesis.  Their  properties  and  performance 
are  quantitatively  studied  by  computer  simulation  using  two 
types  of  images.  The  first  type  consists  of  computer  gener- 
ated images  which  contain  targets  and  two  random  noise  com- 
ponents. One  noise  component  is  uncorrelated,  or  "white" 
Gaussian  noise.  The  other  noise  component  is  correlated,  or 
"colored"  noise  modeled  by  two  Markov  processes- -first  order 
and  second  order  [14,19]  . These  correlated  noises  are  used 
to  simulate  background  clutter.  In  these  computer  generated 
imagfes,  the  statistical  properties  of  the  correlated  noise 
are  known  "a  priori."  The  second  type  of  image  is  a set  of 
twenty  frames  of  real  world  infrared  images.  Here,  correlated 
noise  in  both  spatial  and  temporal  domains  is  not  known  "a 
priori."  Practical  filter  design  procedures  are  developed 
which  first  "learn"  the  statistics  from  the  real  world  image, 
then  design  a filter  using  the  techniques  developed  in  Chapters 
III  and  IV.  Using  single  frames  of  these  real  world  images, 
clutter  suppression  of  up  to  27  db  has  been  achieved  by  spatial 
filtering  alone.  Using  five  frames,  clutter  suppression  of 
up  to  87  db  has  been  achieved  by  sequential  spatial- temporal 
filters.  These  large  clutter  suppression  values  based  on 
computer  simulated  tests  on  real  world  infrared  images  are 


the  most  important  testimony  of  the  practical  usefulness  of 
the  statistical  focal  plane  processing  algorithms  developed 
in  this  thesis. 

In  Chapters  VII  and  VIII,  adaptive  design  procedures  are 
developed  to  further  extend  the  concept  of  clutter  suppression 
using  the  nonrecursive  spatial  filter.  No  "a  priori"  knowledge 
of  the  statistical  properties  of  the  clutter  is  needed  to 
design  the  filter.  The  adaptive  procedure  automatically 
corrects  the  filter  coefficients  iteratively  toward  the 
optimal  values  to  yield  the  minimum  erTor  between  the  target 
estimate  and  a selected  desired  response.  The  concept  of  one 
dimensional  adaptive  filters  based  on  the  least  mean  square 
error  criterion  has  been  very  well  developed  by  Widrow,  McCool, 
et  al.  [20-22].  This  thesis  extends  the  basic  concept  to  two 
dimensions  and  also  develops  the  following  new  techniques  to 
improve  the  performance  of  the  adaptive  spatial  filter: 

1.  Derivation  of  desired  responses  corresponding  to 
various  types  of  targets  of  interest. 

2.  An  "automatic  gain  control"  procedure  which  yields 
constant  misadjustment  for  varying  statistical  properties  of 
the  clutter,  prevents  overflow  and  assures  adaptive  conver- 
gence. 

3.  Dividing  an  image  into  small  subimage  zones  to  carry 
out  filter  adaptations  if  the  statistical  properties  of  the 
image  are  both  "nonstationary"  and  unknown  a priori. 
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Simulation  results  are  given  in  both  Chapters  VII  and 
VIII  which  demonstrate  the  efficacy  of  the  proposed  design 
procedures. 

Chapter  IX  contains  a summary  of  the  results  developed 
in  this  thesis  and  conclusions. 


II.  BASIC  CONCEPT  AND  PROCEDURES  OF  NONRECURSIVE 
afATtSTlCAL  FOCAL  PUuIl  PROCESSING 

A.  INTRODUCTION 

Focal  plane  processing  has  a wide  range  of  objectives 
such  as  optical  filtering,  sensing,  multiplexing,  signal 
formating,  background  clutter  suppression,  thresholding, 
target  tracking,  target  discrimination,  target  recognition, 
and  many  others.  This  thesis  is  only  concerned  with  back- 
ground clutter  suppression  and  thresholding.  They  are  two 
old  problems  taking  on  new  urgency  and  demanding  requirements 
due  to  the  recent  developments  of  "mosaic  focal  plane  arrays" 
and  "smart  sensors." 

The  thresholding  process  is  not  significantly  different 
from  that  developed  for  radar.  However,  clutter  suppression 
algorithms  will  be  drastically  different  from  those  developed 
for  radar  and  for  old  infrared  systems  using  only  a small 
number  of  detectors.  New  focal  plane  processing  techniques 
capable  of  suppressing  clutter  by  several  ten's  of  db's  are 
urgently  needed  to  meet  demanding  requirements  of  new  sur- 
veillance and  guidance  systems. 

Five  nonrecursive  statistical  focal  plane  processing 
algorithms  are  developed  in  this  thesis  for  clutter  suppression. 
These  are  followed  by  a thresholding  step  to  initiate  the 
target  detection  process.  Although  differing  in  detailed 


implementation,  they  share  the  same  basic  concept  and  filter 
configurations.  The  main  difference  lies  in  the  design  of 
their  filter  coefficients.  They  will  be  presented  in  this 
chapter.  An  appreciation  of  the  common  underlying  concept 
will  help  to  place  in  proper  perspective  the  detailed  devel- 
opments of  all  five  statistical  filters  in  the  following 
chapters . 

B.  BASIC  CONCEPT  OF  NONRECURSIVE  STATISTICAL 

FILTERS  FOR  CLUTTER  SUPPRESSION 

One  of  the  major  objectives  of  focal  plane  processing 
developed  in  this  thesis  is  background  clutter  suppression. 

In  infrared  mosaic  focal  plane  array  systems,  clutter  origin- 
ates from  thermal  radiations  in  the  background  scene  in  the 
field  of  view  of  the  sensor  system.  Since  the  background 
scene  has  well  defined  spatial  shapes  and  temperature  distri- 
butions, the  background  clutter  noise  in  the  image  must  have 
well  defined  spatial  shapes  or  structures  also  which  may  be 
contaminated  by  scattering  through  .the  atmosphere,  distortion 
through  the  optical  and  electronic  components,  and  different 
noise  sources.  In  other  words,  the  clutter  noise  is  a random 
signal  with  well  defined  spatial  structure  for  a given  scene. 

This  information  on  the  clutter  noise  is  usefu'  in  helping  to 
achieve  its  suppression.  However,  the  important  concept  of 
the  statistical  filter  is  the  assertion  that  although  the 
spatial  structure  of  the  background  clutter  varies  with  the 
scene,  the  statistical  characteristics  of  the  spatial  structure 
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over  a large  area  may  be  described  by  well  defined  statis- 
tical characterizations  such  as  the  correlation  matrix, 
autocorrelation  function  or  power  spectral  density.  If  this 
is  true,  a spatial  filter  can  be  designed  to  use  the  signals 
around  a selected  pixel  or  over  its  neighborhood  to  process 
the  signal  at  that  pixel.  Since  background  clutter  has  well 
defined  statistical  spatial  behavior  while  the  target  of 
interest  only  dwells  in  one  pixel,  or  several  pixels  of  well 
defined  location,  signals  in  the  neighborhood  can  be  properly 
used  to  suppress  the  spatially  related  background  clutter  and 
thus  raise  the  target  signal  out  of  the  clutter.  This  is  the 
basic  concept  of  the  statistical  spatial  filter  for  clutter 
suppression.  The  filter  can  be  designed  by  performing  a 
statistical  estimation  of  the  target  signal,  using  one  of 
several  criteria.  They  will  be  explained  in  a later  section. 

The  statistical  correlation  concept  in  the  spatial  domain 
can  be  extended  to  the  temporal  domain  also.  If  successive 
frames  of  images  are  fairly  well  registered,  with  small  amounts 
of  drift  and  jitter  in  between  frames,  it  is  reasonable  to 
expect  that  the  signals  are  correlated  in  temporal  domain. 

If  this  is  true,  a temporal  filter  can  be  designed  that  will 
use  the  signals  at  the  same  pixel  location  of  successive  frames 
of  images  to  process  the  signal  at  one  of  the  frames  for  sup- 
pression of  the  temporally  correlated  clutter. 

In  summary,  if  background  clutter  sources  are  related 
(in  the  statistical  sense)  either  spatially  in  a single  frame 
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or  temporally  over  several  frames,  signals  in  both  the  spatial 
and  temporal  neighborhood  can  be  used  together  to  process  the 
signal  at  the  selected  pixel  for  suppressing  the  clutter. 

These  unprocessed  signals  are  multiplied  by  the  filter  coef- 
ficients and  summed  together  to  provide  the  processed  signal 
at  the  selected  pixel.  Therefore,  it  is  a "nonrecursive" 
filter  operation.  The  filter  configuration  will  be  described 
in  the  following  section. 


C.  CONFIGURATION  OF  NONRECURSIVE  FILTERS 


1.  Nonadaptive  Nonrecursive  Filters 

In  the  previous  section,  the  concept  of  nonrecursive 
filtering  using  unprocessed  signals  in  the  neighborhood  around 
a selected  pixel,  to  be  called  the  "estimation  pixel,"  was 
introduced.  The  purpose  of  such  a filter  is  to  suppress  the 
background  clutter  by  performing  a statistical  estimation  of 
the  target  signal  at  that  pixel.  The  neighborhood  area  where 
the  filtering  is  carried  out  is  called  the  "search  box."  The 
location  of  the  "estimation  pixel"  is  usually  inside  the 
"search  box"  but  can  also  be  outside.  For  symmetrical  clutter 
characteristics,  it  is  best  to  have  the  "estimation  pixel"  in 
the  middle  of  the  search  box.  However,  it  must  be  moved 


toward  the  edges  of  the  search  box  when  the  estimation  pixel 
is  located  at  the  edge  of  an  image  because  there  is  no  signal 
outside  the  image. 


go 


In  summary,  unprocessed  signals  in  a search  box  are 
used  to  process  the  signal  at  only  one  "estimation  pixel" 
inside  the  search  box.  The  estimation  pixel  is  then  scanned 
throughout  the  image.  This  filter  configuration  is  further 
described  in  two  cases  shown  in  Fig.  2-1  and  2-2  for  a spatial 
filter  and  a spatial-temporal  filter  respectively. 

Let  XT  * unprocessed  signal  ■ ST  + NT  (2-1) 

T D 

S » targets  of  interest  * [s,  s,  s.  ...sT](2-2) 

1 > L , 1 > 1 

T D 

N ■ sum  of  all  noise  components  including  (2-3) 
uncorrelates  "white"  noise  and 
correlated  "colored"  noise  ■ 

*-nl,n2,ni,  * * *nI^ 

where  i » 1,2,... I and  I is  the  total  number 

of  pixels  in  the  search  box. 

CASE  I - Spatial  Filter  (Fig.  2-1) 

A nonrecursive  spatial  filter  is  described  by  a set  of 
filter  coefficients,  or  weighting  coefficients,  over  the  area 
of  a "search  box."  The  set  of  filter  coefficients  is  repre- 
sented by  a vector  W.  The  intensity  of  the  unprocessed 
signals  - in  the  search  box,  represented  by  the  vector  X,  are 
multiplied  by  the  weighting  coefficients,  (the  vector  "W")  corre- 
sponding to  the  same  pixel  location  in  the  same  search  box  and 
summed  together  to  give  the  output  intensity  at  the  estimation 
pixel,  y,  that  is, 

y - WT*X 

The  filter  coefficients  are  designed  by  different  criteria  to 
be  described  in  the  following  section.  Spatial-filtering  using 
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igure  2-1  Configuration  of  Nonadaptive  Two  Dimensional 
iJonrecursive  Spatial  Filter 


f 


L - 


one  search  box  will  yield  a processed  signal,  called  the 
"estimation  signal,''  of  only  one  pixel,  the  "estimation  pixel." 

The  search  box  is  then  moved,  following  the  scanning  of  the 
"estimation  pixel"  throughout  the  image. 

This  thesis  concentrates  on  a search  box  size  of  3 by  3 
pixels.  Therefore,  nine  filter  coefficients  are  required. 

The  estimation  pixel  is  usually  the  center  pixel.  It  is  moved 
to  the  middle  of  one  edge  or  one  corner  sometimes,  as  explained 
above. 

CASE  II  - Spatial-Temporal  Filter  (Fig.  2-2) 

In  general,  a three  dimensional  nonrecursive  filter  is 
described  by  a set  of  filter  coefficients,  W,  over  the  volume 
of  a "search  box"  which  consists  of  several  frames  of  a two 
dimensional  box.  For  example,  in  a 3x3x5  search  box,  a 3x3 
search  box  is  used  in  five  successive  frames  of  the  image. 
Altogether,  W consists  of  4S  coefficients.  However,  the 
spatial- temporal  filters  developed  in  this  thesis  are  the 
special  case  which  consists  of  sequentially  applying  a spatial 
filter,  first  on  one  frame  of  image,  then  followed  by  a tempo- 
ral filter,  Wj£,  using  several  successive  frames  of  images. 

For  example,  consider  a sequential  3x3  spatial  filter  followed 
by  a five  frame  temporal  filter.  The  spatial  filter  is  imple- 
mented by  the  same  procedure  described  in  Case  I.  For  the 
five  frame  temporal  filter,  signals  at  the  same  pixel  location 
from  five  successive  frames  are  multiplied  by  the  temporal 


29 


SIKESI 


Three  Frame  Sequential  Spatial-Temporal  Filter 
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Figure  2-2  Configuration  of  Nonadaptive  Three  Dimensional 
Monrecursive  Sequential  Spatial-Temporal  Filter 


filter  coefficients  and  summed  together.  Therefore,  instead 
of  45  filter  coefficients  for  the  general  three  dimensional 
filters,  the  sequential  spatial-temporal  filters  have  only 
14  filter  coefficients.  The  first  nine  coefficients  are  for 


the  spatial  filter.  The  last  five  coefficients  are  for  the 
five  frame  temporal  filter. 

2.  Adaptive  Nonrecursive  Filters  (Fig.  2-3) 


In  this  thesis,  only  an  adaptive  spatial  filter  is 
developed.  Its  configuration  is  an  extension  of  the  spatial 
filter  configuration  shown  in  Fig.  2-1.  The  concept  of  adap- 
tation is  based  on  the  one  dimensional  adaptive  filter  orig- 
inally developed  by  B.  Widrow  [20,21,22]. 

In  the  adaptive  filter,  there  is  an  automatic  correc- 
tion procedure  for  adapting  the  filter  coefficients  by  using 
a feedback  loop  shown  in  Fig.  2-3.  The  search  box  and  oper- 
ation of  an  adaptive  spatial  filter  aTe  still  the  same  as  that 
of  the  nonadaptive  spatial  filter.  However,  the  output  of 
the  spatial  filter  is  now  compared  with  a desired  reference 
signal,  d ^ , by  a subtraction  operation.  The  error  of  this 
comparison  is  multiplied  by  an  adaptive  loop  gain,  u,  and  the 
unprocessed  signal  at  a pixel  to  yield  a correction  term  for 
the  filter  coefficient  corresponding  to  that  pixel.  This 
adaptive  correction  is  carried  out  by  scanning  the  search 
box  over  an  "adaptation  area."  Therefore,  in  the  adaptive 
filter  case  there  are  three  image  areas; 

The  given  image  area, 
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Figure  2-3  Configuration  of  Adaptive  Two  Dimensional 
Nonrecursive  Spatial  Filter 


The  spatial  filter  area  - search  box  area, 

The  adaptation  area  - which  is  in  general 
larger  than  the  search  box  area;  for  example, 

8x8  for  a search  box  of  3x3. 

D.  PRINCIPLE  OF  STATISTICAL  FILTER  DESIGN 

In  section  C,  configurations  of  all  five  statistical 
filters  are  shown  in  three  different  types:  Figures  2-1, 

2-2  and  2-3.  The  common  principle  behind  them  is  to  "sum" 
the  "weighted"  signals  in  the  neighborhood  of  the  "estimation 
pixel."  The  neighborhood  is  defined  in  a general  sense  to 
include  both  spatial  neighborhood  and  temporal  neighborhood. 
Once  the  configuration  is  chosen,  the  only  parameters  remain- 
ing to  describe  the  filter  are  the  weighting  coefficients. 

They  are  designed  by  several  different  criteria. 

Two  criteria  are  used  in  this  thesis. 

1 . Criterion  I - Minimisation  of  Mean  Square  Ertor 

In  this  criterion,  a desired  result  is  selected.  For 
example,  in  the  nonadaptive  spatial  filter  case,  the  objective 
of  spatial  filtering  is  to  estimate  the  target,  s.  However, 
the  output  of  the  filter  only  provides  an  estimate  of  the 

target,  y • 3.  Therefore,  there  is  an  error,  e ■ I - s.  Its 

2 

mean  square  value  is  E(e  ).  The  filter  coefficients,  W,  are 
designed  by  minimization  of  the  mean  squared  error.  This 
filter  is  called  "spatial  MMSE"  filter  or  "spatial  Wiener 
filter"  [14,18,23,24,25,26]. 

A similar  procedure  is  developed  for  the  temporal 
MMSE  filter  and  the  spatial- temporal  MMSE  filter. 
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2.  Criterion  II  - Maximization  of  Signal  to  Noise  Ratio 


In  this  criterion,  the  objective  is  to  maximize  the 
output  signal  to  noise  ratio.  The  filter  designed  by  this 
criterion  is  called  the  ’’spatial  matched  filter.” 

A similar  procedure  is  developed  for  the  temporal 
matched  filter  and  the  spatial- temporal  matched  filter. 


E.  IMAGES  USED  IN  ANALYZING  AND  TESTING  OF  THE 
STATISTICAL  FOCAL  PLANE  PROCESSING 


Two  dimensional  infrared  images  containing  a background 
scene  and  different  targets  have  been  collected  in  the  past 
using  infrared  scanners  and  radiometers.  Although  they 
provide  some  information  on  the  background  and  target,  they 
are  found  inadequate  because  these  instruments  typically  use  only 
a few  detectors.  They  are  scanning  instruments  with  relatively 
large  instantaneous  fields  of  view  and  fairly  broad  spectral 
bands.  Many  of  them  are  not  in  spectral  bands  suitable  for 
target  detection  in  the  new  surveillance  systems.  Therefore, 
there  is  an  acute  lack  of  standard  background  scenes  needed 
for  developing  and  testing  new  focal  plane  processing  algor- 
ithms to  be  used  in  these  new  high  performance  surveillance 
and  guidance  systems  using  smart  sensors. 

In  this  thesis,  a set  of  real  world  infrared  images  of 

twenty  frames  with  relative  drift  of  101  pixel  each  frame, 

2 

selected  by  a responsible  agency,  was  made  available. 


M.  Schlesinger,  Aerospace  Corporation.,  private 
communication. 


They  are  used  extensively  in  testing  both  the  spatial  filters 
and  spatial' temporal  filters.  The  performance  results  are 
the  most  convincing  evidence  of  the  usefulness  of  this  research 
because  the  test  is  based  on  real  world  infrared  images. 

However,  to  carry  out  detailed  research  of  this  statis- 
tical focal  plane  processing,  a wide  variety  of  images  with 
varying  parameters  is  needed.  Since  there  is  simply  no  such 
supply  of  real  world  images  taken  by  the  new  mosaic  focal 
planes,  it  was  necessary  to  develop  a theoretical  model  for 
the  background  clutter.  If  it  can  be  proven  valid,  different 
test  images  can  be  generated  on  a computer  readily  by  simply 
varying  the  appropriate  parameters. 

For  this  purpose,  contaminated  images  have  been  generated 
by  using  the  following  models.  A contaminated  image  consists 
of  three  components. 

1.  Target 

It  is  described  by  its  spatial  shape,  its  movement 

between  frames  and  its  intensity.  The  intensity  is  described 

either  deterministically  by  S,  as  defined  by  eq.  2-2, 

2 

or  statistically  by  a mean  and  variance  . 

2.  Random  Noise 

There  are  two  types.  The  first  type  is  Gaussian  un- 
correlated, or  "white"  noise  described  by  its  mean  yyN  and 
variance  o^2.  The  second  type  is  Gaussian  correlated,  or 
"colored"  noise  - modeled  by  two  Markov  processes  (Appendix  A] . 
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# A first  order  Markov  process  described  by  its  auto- 
correlation function. 

R - a 2 JmUnl 

R aCN  PH  °V 


where  aCN  ■ variance 

PH  • horizontal  correlation  factor 
pv  ■ vertical  correlation  factor 
m - horizontal  coordinate  of  image 
n ■ vertical  coordinate  of  image. 

° A second  order  Markov  process  described  by  its  auto- 
correlation function. 


R » aCN2  p^l  p|nicos  (8Hm)  cos  (8vn) 


where  8^  ■ horizontal  spatial  frequency 
8y  * vertical  spatial  frequency. 
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III.  SINGLE  FRAME  FOCAL  PLANE  PROCESSING  FOR 

CLUTTER  SUPPRESSION  - NONRECURSIVE  STATISTICAL 
SPATIAL  FILTERS 

A.  INTRODUCTION 

In  this  chapter,  two  statistical  spatial  filters  which 
use  only  one  frame  of  an  image  are  developed.  One  is  designed 
by  minimizing  a mean  square  error  criterion.  This  type  of 
filter  is  called  "MMSE"  filter,  which  is  more  commonly  known 
as  a Wiener  filter.  It  provides  an  "optimal"  estimate  of  the 
target  signal  and  will  be  developed  in  Section  C.  The  second 
type  is  designed  by  maximizing  the  output  signal  to  noise 
ratio  criterion  and  is  commonly  known  as  the  matched  filter. 

It  will  be  developed  in  Section  D. 

These  two  statistical  design  procedures  can  be  equally 
well  applied  to  focal  plane  processing  using  several  frames 
of  images  in  the  form  of  three  dimensional  spatial- temporal 
or  temporal -spatial  filters.  They  will  be  developed  in  the 
next  chapter. 

Both  the  spatial  filters  developed  in  this  chapter  and 
the  spatial- temporal  filters  developed  in  the  next  chapter 
will  be  evaluated  by  using  two  types  of  images.  One  type  is 
computer  generated  images  containing  correlated  noise  modeled 
by  a Markov  process  to  simulate  background  clutter.  The  other 
type  is  a real  world  infrared  image.  The  results  from  both 
simulated  and  real  world  scenes  are  presented  together  in 
Chapter  VI . 


> 1 
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B.  CONFIGURATION  OF  TWO  DIMENSIONAL 
NONRECURSIVE  SPATIAL  FILTERS 


Although  the  design  criteria  of  two  statistical  spatial 
filters  developed  in  this  chapter  are  different,  they  share 
the  same  filter  configurations  as  shown  in  Fig.  3-1.  There- 
fore, the  filter  configuration  and  operation  procedure  will 
be  described  before  their  individual  design  criteria  are 
presented  in  the  next  two  sections. 

In  these  spatial  filters,  signals  in  the  neighborhood 
of  a selected  pixel  of  interest  are  used  together  to  help  the 
processing  of  signals  at  that  pixel.  The  selected  neighbor- 
hood is  called  a "search  box."  As  explained  in  Chapter  II 
and  the  previous  section,  the  objective  is  to  suppress  the 
background  clutter  by  performing  an  estimation  of  the  target 
signal  at  that  pixel,  using  its  neighborhing  signals  and  the 
knowledge  of  their  statistical  spatial  correlation  properties. 
This  is  carried  out  by  designing  a set  of  weighting  coefficients 
or  filter  coefficients,  W.  For  every  pixel  in  the  search  box, 
a weighting  coefficient  is  assigned.  Signals  of  all  pixels, 

X,  in  the  search  box  are  multiplied  by  their  corresponding 
filter  coefficients,  W,  and  summed  together  to  give  an  "optimal" 
estimate  of  the  target  intensity  at  the  "estimation  pixel," 
which  can  be  anywhere  inside  the  search  box.  It  could  also 

be  located  outside  the  search  box  although  this  is  not  devel- 

» 

oped  in  this  thesis.'  In  general,  the  location  of  the  "esti- 
mation pixel"  is  in,  or  close  to,  the  middle  of  the  search  box 


{ J 
i 


( ) 


because  common  sense  suggested  that  spatial  behaviors  in  all 
directions  around  the  estimation  pixel  should  be  used  to 
reveal  the  spatial  behavior  of  background  clutter  and  to  help 
achieve  their  suppression.  However,  there  are  situations 
where  signals  in  certain  parts  of  the  neighborhood  do  not 
exist;  for  example,  when  the  estimation  pixel  is  located  at 
the  edge  of  an  image.  In  these  cases,  it  is  not  possible  to 
have  the  estimation  pixel  in  the  middle  of  the  filter. 

Instead,  it  must  be  off  to  the  side,  as  will  be  shown  later 
by  several  examples. 

The  size  and  shape  of  the  search  box  can  also  vary.  Only 
square  shaped  search  boxes  are  developed  in  this  thesis  be- 
cause the  correlation  properties  in  vertical  and  horizontal 
directions  are  assumed  to  be  quite  close.  On  the  other  hand, 
the  concept  and  design  procedure  developed  in  this  thesis  can 
be  easily  extended  to  non-square-shaped  search  boxes  if  needed; 
for  example,  if  the  correlation  properties  in  the  vertical 
direction  are  significantly  different  from  those  in  the 
horizontal  direction. 

The  size  of  the  search  box  depends  on  the  correlation 
property  of  the  background  clutter  and  on  the  size  of  the 
targets  of  interest.  If  the  spatial  correlation  of  the  clutter 
is  strong,  there  is  no  need  to  go  beyond  a few  neighboring 
pixels  to  determine  the  correlation  properties.  Therefore, 
a small  search  box  is  sufficient  to  accomplish  an  effective 
suppression  of  background  clutter.  On  the  other  hand,  if 
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the  spatial  correlation  of  clutter  is  weak,  one  needs  further 
away  neighboring  pixels  to  obtain  the  correlation  properties 
properly  and  a larger  search  box  is  needed.  In  this  thesis, 
a 3x3  search  box  is  developed  almost  exclusively  because  it 
was  found  that  the  correlation  properties  of  several  real 
world  infrared  images  are  quite  strong.  In  terms  of  a corre- 
lation factor,  on  a scale  from  0 to  1 corresponding  to  no 
correlation  (white  noise)  to  perfect  correlation  (determin- 
istic) , the  real  world  images  examined  in  this  thesis  indicated 
a range  of  values  above  0.8.  On  the  other  hand,  the  concept 
and  design  procedure  developed  in  this  thesis  can  be  easily 
extended  to  large  sizes  such  as  4x4,  5x5,  etc. 

In  summary,  nonrecursive  spatial  filters  developed  in 
this  chapter  consist  of  a search  box  for  .every  pixel  of  in- 
terest in  the  image,  called  the  "estimation  pixel."  Because 
secondary  signals  in  the  search  box  are  used  to  estimate  the 
target  at  the  estimation  pixel,  target  estimation  pixel 
can  be  moved  to  any  part  of  the  image  or  scanned  to  cover  any 
selected  corner  of  the  image.  In  this  thesis,  a raster  scan 
of  the  estimation  pixel  is  used  to  cover  the  whole  image. 

When  the  estimation  pixel  is  at  the  corner  or  along  the  edges 
of  the  image,  it  cannot  be  located  in  the  middle  of  the  search 
box.  On  the  other  hand,  whenever  possible  it  will  be  located 
in  the  center.  For  every  search  box,  signals  of  all  pixels 
are  weighted  and  summed  to  give  an  estimate  of  the  target 
intensity  at  only  one  pixel  inside  the  box,  the  estimation  pixel. 
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The  weighting  coefficients  are  designed  using  different 
criteria.  Two  of  these  design  procedures  are  presented  in 
the  next  two  sections. 
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C.  NONRECURSIVE  SPATIAL  MMSE  FILTER 
1.  Principle  of  Optimal  Estimation 

The  objective  of  the  spatial  MMSE  filter  is  to  give 
a processed  signal  Y ■ fy(m0,n0)  be  the  "optimal" 

estimate  of  the  target  of  interest,  S ■ f5(™0»n0)  where 
(mQ,n0)  are  the  indices  of  the  estimation  pixel.  The  cri- 
terion for  "optimality"  is  the  "minimum  mean  square  error" 
(MMSE),  sometimes  known  as  the  Wiener  filter.  The  theoretical 
derivation  of  the  MMSE  filter  is  well  known  and  more  detailed 
information  can  be  found  in  the  following  references: 

- Reference  18  states  the  general  MMSE  criteria. 

- Reference  23  describes  an  image  restoration  technique 
using  spatial  frequency  domain  design  technique. 

- Reference  24  describes  an  image  enhancement  technique 
based  on  the  MMSE  algorithm  using,  again,  spatial  fre- 
quency domain  design  method,  requiring  efficient  trans- 
formation techniques. 

- Reference  25  describes  in  detail  the  spatial  domain 
derivation  algorithm  for  the  MMSE  filter  considering 
some  implementation  methods  in  the  frequency  domain. 

- Reference  26  describes  the  linear  algebraic  image  restor- 
ation method  in  general,  and  the  least  squares  technique 
including  the  Wiener  filter  formulation  in  particular. 

The  design  equations,  both  in  spatial  and  spatial  fre- 
quency domain,  are  presented. 


I 
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A practical  method  of  implementation  of  spatial 
Wiener  filter  for  suppression  of  correlated  noise  and  enhance- 
ment of  point  and  line  target  was  suggested  in  Ref.  14.  This 
design  method  will  be  further  extended  here  and  in  Chapter  IV, 
which  presents  multiple  plane  spatial  temporal  filtering. 

The  design  procedure  is  presented  in  the  following  paragraphs. 

[Step  I]  Description  of  Unprocessed  Image: 

The  unprocessed  signal  of  the  whole  image  X is  given 
by  a two  dimensional  array  shown  in  Fig.  3- 2 (a). 


11  X21 

’ • ’ XMMAX 

1 

12  x22 

XMMAX 

2 

1 NMAX 

XMMAX, 

NMAX 

S + N 


(3-3.1) 


where  x » intensity  of  unprocessed  signal  (3-3. 1(a)) 

S ■ target  signal  of  interest  (3-3. 1(b)) 

N * sum  of  all  noise  sources  (3-3. 1(c)) 

MMAX  - number  of  horizontal  pixels  in  the  image 
NMAX  - number  of  vertical  pixels  in  the  image. 

The  original  signals  inside  the  spatial  filter  search  box  are 
given  by  a smaller  two  dimensional  array. 


m,n 

xm+l,n  * ‘ ’ 

xm+MSB,n 

m,n+l 

xm+l ,n+l 

xm+MSB,n+l 

m,NSB 

Xm+1,NSB 

xm+MSB,n+NSB 

(3-3.2) 
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Filter  Configuration 
it  Samples  Vector 


ions  of  Nonrecursive  Spatial  Filter 


u 


• • • 


(3-3.5) 


nF"  WES,”‘  WI^ 


where  w^g  * filter  coefficient  at  the  estimation  pixel 


(MES.NES) . 


[Step  II]  Filtered  Image  and  Mean  Square  Error: 

The  output  of  the  filter  is: 

y - XT«W  • s (3-3.6) 

where  s • estimate  of  the  target  signal  at  the  estimation 
pixel  (MES.NES). 

Let  us  define  the  estimation  error  as 

e (MES.NES)  - s(MES.NES)  - s(MES.NES)  (3-3.7) 

The  mean  square  error  is  then  the  expectation  value 

E[e2(MES,NES)]  - E{ [s (MES ,NES)  - s(MES.NES)]} 

- E( [s (MES.NES)  - XT*W]2}  (3-3.8) 

[Step  III]  Minimization  of  Mean  Square  Errors: 

To  minimize  (3-3.8) , it  is  differentiated  with  respect 
to  W and  is  then  equated  to  zero. 

^ E[e2 (MES.NES) ] - E{ -X* 2 [s (MES ,NES)  - XT*W] > 

• E{ -X* 2 e } « 0 (3-3.9) 


Equation  (3-3.9)  shows  that  the  estimation  error  is  orthogonal 
to  the  unprocessed  signal  X.  Further  simplification  of  (3-3.9) 
gives : 


bJ 


Let  us  define 

P 2 E[X*  s(MES,NES)  ] 


(3-3.11) 


cross  correlation  between  the  unprocessed 
image  signal  X and  the  target  signal  of 
interest. 


— r 9 9 — 

Rxx  E[X.XT]  - E(x2  xx)  E(x2  x2)  . . . E(x2(Xj) 


E(x^  x^)  E(x^  x2)  ...  E(x^^Xj) 


?(XI,X1) 


E(Xj  ^Xj) 


(3-3.12) 


* correlation  matrix  of  the  unprocessed 
image  signal. 


[Step  IV]  Equation  of  Filter  Design: 


Equation  (3-3.10)  is  now  expressed  as: 


RXX.W  - P 


w - Rxx1  -p 


(3-3.13) 


It  is  a set  of  I simultaneous  linear  equations  used 


to  solve  for  the  weighting  coefficients,  or  filter  coeffi- 


cients, of  the  two-  dimensional  spatial  MMSE  filter  for  target 


estimation. 


In  many  practical  applications,  we  assume  that  the 
target  signal  S and  the  noise  N are  uncorrelated.  If  we 


further  assume  that  the  mean  of  the  noise  is  zero,  then 


i 


j i nil  
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Rxx  " Rss  * rnn 


(3-3.14) 


where  Rss  • correlation  matrix  of  the  target  signal 

RNN  " cov,ir*ance  of  the  noise. 

The  filter  coefficients  (3-3.13)  are  given  by: 


WWF  " * RSS^  *P 


(3-3.15) 


The  subscript  WF  stands  for  "Wiener  Filter." 

2.  Design  Procedure  for  Spatial  MMSE  Filter  (Ref.  1] 

To  design  a spatial  MMSE  filter,  a three  step  procedure 
is  used.  The  first  step  is  to  calculate  the  statistical  proper- 
ties of  the  targets  Rgg  and  P.  The  second  step  is  to  calculate 
the  statistical  property  of  the  background  clutter  noise  RNN‘ 
The  last  step  is  to  calculate  the  filter  coefficients  by 

solving  (3-3.15).  They  will  be  explained  in  more  detail  in  the 

0 

following. 


[Step  I]  Calculations  of  Statistical  Properties  of  the  Targets 
Rss  and  P:  [14] 

The  calculation  of  Rss  and  P are  relatively  straight- 
forward. They  depend  on  the  type  of  target  signal.  Once  the 
target  signal  of  interest  is  given,  as  shown  by  several 
examples  of  point  target  and  line  targets  in  Fig.  3-3, 

R--  and  P are  calculated  by  the  following  expressions: 
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Fig.  3-3*7  1 Fig.  5-3*8  ••  Fig.  j-o*9 

Some,  target  configuration  with  respect  to  search  box 

Figure  3-3  Examples  of  Different  Estimation  Pixel  Locations 
ami  Different  Target  Types 


E C s 2_  E(s^  s2)  • 
ECs2>si)  E^s2,s2^  * 


* E(S1,S9} 

• E(s2,S9^ 


(3-3-16) 


5Cs9,sx) 

ECs5>Xi) 

E(s5>x2) 


E(s5>xg) 


E(s9^s9) 


E^s5,s1^ 

E(s5,s2) 


e(s5>s9) 


(3-3-17) 


Notice  that  s5  is  the  signal  at  the  E.P.  for  a 3x3  search  box. 
Two  special  cases  will  be  presented.  The  first  case 

is  for  point  targets  and  for  a central  estimation  pixel. 
Under  those  conditions,  s^  * T,  and  all  other  s's  are  zero. 

RFoooooootn 


0 ...  0 ....  . 


(3-3.18) 


(3-3.19) 


where  T » intensity  of  the  point  target. 

The  second  case  is  for  a horizontal  line  target,  as 
shown  in  Fig.  3-3. 7 (a),  and  for  a central  estimation  pixel. 
Under  these  conditions,  s4,  ss  and  s6  are  not  zero;  all  other 
s's  are  zero. 
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0 
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E(s5s4) 


E(s5s5) 


E(s5s6) 


(3-3.20) 


(3-3-21) 


The  amplitude  of  the  line  target  s4,  s5,  s&  can  be 
either  deterministic  or  statistical.  In  many  applications,  a 
deterministic  target  amplitude  is  considered.  If  the  interest 
is  only  in  the  location  of  the  targets,  s4  - s5 * s6 * constant. 
If  the  amplitude  of  the  target  signal  is  known,  s4,  s^,  and  s^ 
will  be  proportional  to  its  spatial  variations. 


Statistical  amplitudes  are  useful  in  cases  where  a large 
number  of  targets  are  expected  and  their  amplitudes  are 
described  statistically,  for  example,  by  a probability 
density  function.  This  problem  will  be  discussed  further 
in  Chapter  V where  a target  detection  procedure  is  devel- 


oped. 


manner. 


Other  types  of  targets  can  be  handled  in  a similar 


[Step  II]  Calculation  of  R^: 

Two  procedures  are  used  in  this  thesis  to  calculate 
the  covariance  matrix  of  the  background  clutter  noise, 
depending  on  the  type  of  images  used  in  the  analysis. 

1.  Computer  Generated  Images: 

It  is  assumed  that  background  clutters  in  real 
infrared  images  can  be  modeled  by  Markov  processes.  Their 
autocorrelation  functions  can  be  described  by  the  following 
closed-form  mathematical  expressions: 


where 


First  order  Markov  process: 

Q(m,n)  - ac^  p^ml  p|nl  (3-3.21) 

Second  order  Markov  process: 

Q(m,n)  * oc^  p^l  pj^lcos  (8Hm)  cos  (8vn)  (3-3.22) 

* variance  of  correlated  noise  which  is  used 
L to  model  the  clutter. 

PH  * horizontal  correlation  coefficient  between 
two  adjacent  pixels. 


Pv  - vertical  correlation  coefficient  between  two 
adjacent  pixels. 

gu  ■ a)  ■ horizontal  spatial  frequency  (for  2nd 
m order  Markov  process) 

gv  " wn  “ vertical  spatial  frequency  (for  2nd  order 
Markov  process) 

These  two  dimensional  correlated  random  noise  sources 
can  be  simulated  by  a recursive  procedure  described  in  Appendix 
A to  generate  simulated  background  clutter  images.  For  these 
images,  RNN  can  be  calculated  easily  [14]. 

2.  Real  World  Infrared  Image: 

If  real  world  infrared  images  are  given,  their  sta- 
tistical characteristics  must  be  calculated  directly  from  the 
given  images,  using  eq.  (3-3.12)  and  then  averaging  it  over  a 
large  number  of  pixels  to  obtain  its  expected  value.  It  must 
be  pointed  out  if  the  number  of  targets  in  the  image  is  high, 
and  their  amplitudes  are  high,  they  will  cause  error  in  the 
calculation  of  the  statistical  properties  of  the  clutter. 

The  analysis  of  a real  world  infrared  image  was  made  by 
Captain  D.  Hilmers  in  his  thesis  research  [30]  . 

(Step  III].  Design  of  Filter  coefficients: 

After  the  calculations  of  RgS,  P and  R^N,  the  filter 
coefficients  are  designed  by  solving  eq.  (3-3.15). 

3,  Figure  of  Merit  for  Clutter  Suppression  - 

processing  Gain 

To  evaluate  the  performance  of  the  designed  filter, 
the  processing  gain  (PG)  was  selected  as  a figure  of  merit. 
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The  PG  definition  is: 

(.Signal  power/Noise  power)  At  filter  output 


PG  - 


(Signal  power/Noise  power)  At  filter  input 

(3-3.23) 


The  PG  is  given  by  the  following  equations: 
Input  signal  power  at  a given  pixel  ■ s2 


ps. 


Input  noise  power  at  a given  pixel 
_ 2 


D 2 2 

°N  + UN"  PN, 


'N 


*N 


is  noise  variance,  defined  by  (3-3.22) 
is  noise  mean 


'Xu,.  2 


Output  signal  power  at  estimation  pixel  ■ (S  *W) 
where  s1  was  defined  by  eq.  (2-2)  and  w by  eq.  (3-3. S) 
Output  noise  power  at  estimation  pixel  ■ 


*°S, 


E[(NT*W)2] 


E[WT*N*N^W] 


WT*E[N*NT] *w 


wt«r 


NN 


■w 


* pn 


where  RNN  defined  by  (3-3.13). 
Therefore,  the  PG  is: 


PG 


(Ps0/pN0)  (ST.W)2/(WT.Rnh.W) 

Tps7pn7  r 


S4/(c^  ♦ Ujf  ) 


(3-3.24) 


where  and  were  presented  in  Section  II. E.  2. 

For  a point  target  and  zero  mean  noise,  the  PG  will  become: 


PG 


s2*w2(MES,NES)/  <?n2  WT*RjfN*W  w“  (MES  , NES) 


s2/(aN2  ) 


wT.rnP.k 


(3-3. 25) 


A 2 
'NN  aN 


Rxltr  ■ aw‘  • and  wC MES, NES  ) is  the  filter 


where 

coefficient  at  the  estimation  pixel. 


ss 


4.  Results  of  Computer  Simulation 

Properties  of  nonrecursive  spatial  MMSE  filters 
and  their  performances  in  clutter  suppression  and  target 
detection,  when  combined  with  the  thresholding  process,  are 
investigated  by  computer  simulation.  Two  types  of  images 
were  used.  One  is  a computer  generated  image  containing 
spatially  correlated  noise  represented  by  Markov  models  to 
simulate  background  clutter.  The  other  is  a real  world 
infrared  image. 

The  search  box  size  is  limited  to  a 3x3  square. 

Point  targets  are  used  in  most  of  the  computer  simulation. 

The  estimation  pixel  is  usually  in  the  center  of  the  3x3  box. 
It  is  moved  to  the  side  of  the  3x3  only  when  the  estimation 
pixel  is  along  the  edges  of  the  image. 

Investigation  of  the  filters  is  carried  out  over  a 
range  of  input  conditions: 

SNRI  ■ Input  power  signal  to  noise  ratio 

■ *21  db  to  0 db 

■ Correlation  factor  ■ 0.999  to  0.4. 

For  target  detection,  a probability  of  false  alarm  (PpA)  in 
the  range  of  10*1  to  10’ 5 is  selected  as  a parameter. 

The  computer  simulation  results  are  presented  in 
Chapter  VI  where  both  single  frame  spatial  filter  results  and 
multiple  frame  spatial-temporal  filter  results  are  presented 
together.  Two  types  of  presentations  are  used.  The  first 
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type  is  quantitative  and  does  not  use  two  dimensional  pic- 
tures. Filter  properties  such  as  filter  coefficients  will 
be  presented  as  functions  of  input  signal  to  noise  ratio  and 
correlation  factor.  Filter  performance,  such  as  processing 
gain  for  clutter  suppression  and  probability  of  detection 
for  target  detection,  is  related  to  input  signal  to  noise 
ratio  while  the  correlation  factor  and  probability  of  false 
alarm  are  selected  as  parameters.  The  second  type  of  presen- 
tation is  pictorial  and  uses  two  dimensional  images.  Computer 
printouts  using  nine  gray  levels  are  used  to  present  the 
unprocessed  image,  processed  image  after  the  application  of 
spatial  filter  and  images  after  further  processing  by  thresh- 
olding. 

i 

D.  NONRECURSIVE  SPATIAL  MATCHED  FILTERS 

1.  Principle  of  Maximizing  Signal  to  Noise  Ratio  [Ref.  27-29] 

The  objective  of  the  spatial  matched  filter  is  to  give 
a processed  signal,  Y ■ fY(mo,no)  will  provide  the  max- 

imum output  target  signal  to  total  noise  ratio.  The  filter 
design  procedure  is  presented  in  the  following  paragraphs  and 
is  an  extension  to  two  dimensions  based  on  the  theoretical 
derivation  of  Appelbaum  [29]. 

[Step  I]  Unprocessed  Image; 

The  configuration  of  the  nonrecursive  spatial  matched 
filter  is  the  same  as  that  of  the  MMSE  filter.  The  description 
of  unprocessed  image  and  filters  is  the  same  also  as  presented 
in  Section  B.l. 


57 


(3-4.1) 


U 


X • [x^  Xj  • • *Xj] 
X - S ♦ N 

The  filter  is  described  by 


C3-4.2) 


(3-4.3) 


[Step  II]  Filtered  Image  and  Output  Signal  to  Noise  Ratio: 
The  output  of  the  filter  is 


XT.W 


y contains  two  components: 


N 


where 


Vg  * output  signal  voltage  * S*W 

T 

vN  * output  noise  voltage  = N • W 


(3-4.4) 

(3-4.5) 

(3-4.6) 

(3-4.7) 


The  output  signal  power  is  jv^j  . The  output  noise  power  is 

2 

the  expected  value  of  [v  ,u- 


n i 


Pn  - Efvn*vn]  » E[|NT.W|2]  = E[WT*N*NT  W] 


T*  * T 

» E[N  N 1 ] W 
’ wT*rnn-w 


(3-4.8) 


(the  superscript  * refers  to  the  complex  conjugate  wherever  a 
superscripted  variable  is  complex;  otherwise  t-he  * can  be  ignored) 


where 


NN 


is  the  covariance  matrix  of  the  noise  given  by 


(3-4.9) 


ECN1N1) 

ecn1n2)  . 

. . ECNjNj) 

rnn  ■ 

ecn2Ni) 

• 

• 

• 

E(N2N2)  . 

• • ECNjNjj 

ECNjNj) 

• • EfNjNj) 
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assuming  N has  a zero  mean.  The  output  power  signal  to  noise 
ratio  is: 


SNR 


out  wt*rnn*w 


(3-4.10) 


A*RnnAT  - I and  R^1  - (AT.A*) 


The  matched  filter  coefficients  can  be  designed  by  maximizing 
(3-4.10).  However,  a more  effective  way  to  derive  the  matched 
filter  design  equation  is  to  diagonalize  the  matrix  R^. 

[Step  III]  Diagonalize  Output  Signal  to  Noise  Ratio: 

Let  A » the  linear  unitary  transformation  which 
diagonalizes  the  matrix  R^N  which  is  equivalent  to  decorre- 
lating  the  input  clutter  noise,  i.e., 

(3-4.11) 

The  new  filter  configuration  is  shown  in  Fig.  3-4.  .The 
resultant  tr  ^sformed  input  signal  and  noise  are: 

S’  - A-S  (3-4.12) 

N’  • A*N  (3-4.13) 

Let  W'  be  the  new  transformed  filter,  then  the  output  signal 
and  noise  voltages  are 

(3-4.14) 
(3-4.15) 


vs  - W’T*S'  - W'T.A*S 


vN  • W,T.N’  • wt.a.n 


Comparison  of  (3-4.13)  and  (3-4.14)  with  (3-4.6)  and  (3-4.7), 
the  relation  between  W and  VT  can  be  found  as 


W - AT*W»  - W’  AT 
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(3-4.16) 


X ■ S ♦ N 
Input  vector 


Original  . 
filter 

configuration 


Linear  Transformation  A 


TraAsformjed 
filter  , 


Figure  3-4  Original  and  Transformed  Filter  Con- 
figurations Used  in  the  Derivation  of 
Spatial  Matched  Filter  Design  Equation 


s2 

s3 

n2 

n3 

The  output  noise  power  after  the  transformation  is 


Since  the  transformation  A diagonalized  the 
the  noise 


The  output  signal  power  after  the  transformation  is 


Therefore,  the  output  signal  to  noise  ratio  is 


[Step  IV]  Equation  of  Matched  Filter  Design: 

The  design  equation  for  the  spatial  matched  filter 
is  obtained  by  finding  the  maximum  value  for  (SNR)QUt.  To 

accomplish  this,  the  Cauchy  Schwarz  inequality  is  applied  to 
(3-4.14). 


where 


Therefore,  the  maximum  output  SNR  is 


CSNR), 


(3-4.26) 


It  will  be  shown  in  the  following  that  the  special 


filter 


W - cS'* 


(3-4.27) 


where  c « an  arbitrarily  selected  constant 


will  provide  the  maximum  (SNR)output.  For  this  filter 
v0  - cS,TS'  - cl  S'  I 2 


c2 I S» | 2 


(SNR) 


(SNR) 


max . 


Thus,  it  has  been  shown  that  the  special  filter,  W'  * cS', 


is  the  matched  filter  after  the  transformation  of  A.  The 


matched  filter  itself  is  expressed  by: 


Jw-  - AT*c»S ' * « AT* c A*S* 


» c A *A*S' 


Using  the  definition  of  (3-4.11) 


c r*;1  .S* 


(3-4.28) 


This  is  the  design  equation  for  the  nonrecursive  spatial  matched 


filter.  Using  this  matched  filter,  the  maximum  signal  to 


noise  ratio  is: 


SNR». 


* * <;* 


RNN  S* 


(3-4.29) 


1 
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It  is  worthwhile  to  note  that  the  maximum  output  signal  to 
noise  ratio  depends  only  on  the  target  signal  and  clutter 
noise  characteristics.  In  active  systems,  such  as  radar  and 
communication  systems,  the  signals  can  be  designed  to  yield 
very  high  SNR.  On  the  other  hand,  in  passive  systems,  such 
as  passive  infrared  and  optical  surveillance  systems,  the 
target  signal  can  not  be  designed.  The  maximum  SNR  is  given 
by  (3-4.29). 

2.  Design  Procedure  of  Spatial  Matched  Filter 

To  design  a nonrecursive  spatial  matched  filter,  a 
procedure  somewhat  similar  to  that  of  the  nonrecursive  spatial 
MMSE  filter  is  used.  This  is  readily  clear  by  comparing  their 
design  equations. 

For  MMSE  filter:  Ww_  - (RMM  ♦ R-J*1  P (3-3.15) 

(Wiener  filter)  WF  NN 

For  matched  filter:  WMp  ■ cRj^'^S*  (3-4.23) 

A three  step  procedure  is  also  used. 

(Step  I]  Selection  of  c and  Calculation  of  S*: 

Although  the  selection  of  c is  arbitrary  from  the 
viewpoint  of  matched  filter  design,  its  selection  is  important 
since  its  value  will  affect  the  threshold  setting  for  target 
detection.  This  will  be  discussed  in  more  detail  in  Chapter  VI. 
In  general,  the  value  of  c is  chosen  so  that  the  filter 
coefficient  corresponding  to  the  estimation  pixel  is  normal- 
ized to  unity. 

\ 
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The  determination  of  S*  is  very  simple.  Two  examples 
will  be  given.  For  a point  target  as  in  Fig.  3- 3*1* 

S*T  - [0  0 0 0 S 0 0 0 0]. 

For  a horizontal  line  target  as  in  Fig.  3-3. 7(a). 

S‘T  • [0  o 0 s S S 0 0 0] 

where  S * amplitude  of  target 

Other  types  of  targets  can  be  handled  in  similar  ways. 

[Step  II]  Calculation  of  R^: 

This  is  exactly  the  same  as  described  in  section  B.2. 

[Step  III]  Calculation  of  Filter  Coefficients: 

The  filter  coefficients  are  calculated  by  solving 
equation  (3-4.28). 

3.  Processing  Gain 

The  processing  gain  (PG)  of  the  matched  filter  is 
derived  in  a way  similar  to  the  derivation  in  section  B.3., 
using  equation  (3-3.24)  as  a generalized  PG  equation.  For 
a point  target,  equation  (3-3. 25)  can  be  used  to  determine 
the  PG.  When  the  constant  c in  the  matched  filter  is  selected 
as  suggested  in  D.2.,  the  PG  of  point  target  will  simply 
become: 


1 


o 


o 


For  a point  target,  assuming  noise  with  zero  mean,  the  P.G. 
can  be  shown  to  be  independent  of  input  SNR.  Defining 
ST  B s (0  0 . . 1 . . 0] 


s-sTI  ani  RNN_1  fi  RNNo  and 


substituting  these  definitions  into  eq.  (3-4.29)  yields: 


PG  - 


SNR( output) 
gEnr — L 
iNR(input) 


C T R “1  C 

5I  KNNP  aI 


SNRmax 
SNR( input) 


c^C^.D  “iff 

S Rnn  Sj 

— — 


( 


This  last  expression  of  P.G.  is  independent  of  signal  and 
noise  power  and  depending  only  on  the  correlation  factor  of 
the  correlated  noise  and  the  target  location  in  the  search 
box. 

4.  Results  of  Computer  Simulation 

Properties  of  nonrecursive  spatial  matched  filters 
and  their  performance  in  clutter  suppression  and  target 
detection  when  combined  with  the  thresholding  process  were 
also  investigated  using  computer  simulation. 

The  items  of  investigation  in  terms  of  search  box 
size,  background  clutter  characteristics,  target  types,  filter 
coefficients,  performance  figures  of  merits,  are  the  same  as 
in  cases  of  nonrecursive  spatial  MMSE  filters.  They  have  been 
described  in  Section  C.4.  and  will  not  be  repeated  here. 

E . SUMMARY 

Two  types  of  statistical  spatial  filters  were  discussed 
in  this  chapter:  the  spatial  MMSE  filter  and  the  spatial 
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matched  filter.  Both  filters  offer  some  signal  processing 
advantages . 

The  MMSE  filter,  designed  to  minimize  the  mean  square 
error,  will  offer  the  best  spatial  estimate  of  a given  target. 

The  matched  filter,  designed  to  maximize  output  signal  to 
noise  ratio,  will  result  in  the  best  enhancement  of  SNR  suit- 
able for  detection  purposes. 

It  turns  out  that  for  the  detection  of  a point  target, 
both  the  MMSE  and  the  matched  filter  offer  the  same  processing 
gain.  This  will  be  shown  in  Chapter  VI. 

In  general,  the  type  of  filter  to  be  selected  will  be 
determined  by  the  practical  processing  requirements  for  a 
given  problem.  For  target  enhancement  and  restoration  tech- 
niques which  require  accurate  estimation  of  the  target's  shape 
and  intensity,  the  Wiener  filter  is  preferred.  For  target 
detection  requirements  which  allow  distortion  of  target's 
shape  and  intensity,  the  matched  filter  is  preferred. 


" ■■  • 


o 
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IV.  MU1TIELE.  FRAMES  FOG At  PLANE  PROCESSING  fQR 

CLUTTER  SUPPRESSION  - NQNRECURSIVE  STATISTICAL 
TEMPORAL  FILTER  AND  SPATIAL -TEMPORAL  FILTERS 

A.  INTRODUCTION 

If  an  imaging  system  can  be  stabilized  or  tracked  to 
follow  a scene,  several  successive  frames  of  images  can  be 
used  for  various  image  processing  purposes.  Signals  from 
multiple  frames  of  images  can  be  used  in  several  ways.  The 
simplest  way  is  to  use  one  pixel  from  each  frame;  signals 
of  the  same  pixel  from  successive  frames  are  used  together 
in  what  amounts  to  temporal  processing.  A more  involved 
way  is  to  use  several  pixels  from  each  frame;  for  example, 
signals  from  nine  pixels  in  a 3x3  search  box  as  developed 
in  Chapter  III  are  used  together  with  signals  of  the  same 
search  box  location  from  consecutive  frames  in  what  amounts 
to  a combined  spatial-temporal  processing. 

In  this  thesis,  an  intermediate  process  is  developed.  A 
spatial  filter  is  first  used  to  process  several  successive 
frames  of  images  individually.  Then,  single  pixels  from 
each  of  these  frames  already  processed  by  the  spatial  filters 
are  used  together  to  perform  a temporal  filtering.  The 
spatial  filters  are  designed  by  statistical  criteria  as  pre- 
sented in  Chapter  III.  The  temporal  filter  will  be  designed 
in  a similar  manner,  using  the  same  principle  - that  if  the 
temporal  noise  is  correlated,  it  can  be  suppressed  by  a 
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nonrecursive  temporal  filter  designed  either  by  a minimiza- 
tion of  mean  square  error  criterion  or  by  a maximization  of 
signal  to  noise  ratio  criterion.  The  objective  of  these 
temporal  filters  is  the  same  as  other  focal  plane  processing 
techniques  developed  in  this  thesis,  namely,  signals  from 
single  frame  and/or  multiple  frames  of  images  are  processed 
to  suppress  the  background  clutter  so  that  weak  targets  buried 
in  them  can  be  pulled  above  the  noise,  thus  enabling  a thresh- 
old to  be  applied  to  initiate  the  target  detection  process. 

In  Section  B,  a class  of  nonstatistical , multiple  frame 
focal  plane  processing  techniques,  called  "frame  differ- 
encing" techniques,  are  first  presented.  An  analysis  is  then 
made  of  their  effects  on  the  statistical  properties  of  the 
images.  These  nonstatistical  techniques  will  be  compared  with 
the  performance  of  statistical  temporal  filters  developed  in 
this  thesis.  In  Section  C,  three  dimensional  statistical 
filters  using  multiple  frames  of  images  are  developed.  Spe- 
cifically, a sequential  combination  of  several  spatial  filters 
and  one  temporal~f liter  is  developed.  In  Section  D,  an  accum- 
ulative implementation  of  the  nonrecursive  temporal  filter  is 
suggested  which  may  simplify  the  memory  requirements  in  hard- 
ware implementation.  In  Section  E,  computer  procedures  for 
investigation  of  these  multiple  frame,  focal  plane  processing 
algorithms  are  described  for  both  simulated  images  with  pre- 
scribed statistical  properties  and  real  world  images  without 
a priori  knowledge  of  their  statistical  properties. 
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However,  the  simulated  results  will  not  be  presented  in 
this  chapter.  They  will  be  presented  in  Chapter  VI,  which 
includes  the  simulated  results  for  both  the  single  frame 
spatial  filters  and  the  multiple  frame  spatial- temporal 
filters . 

B.  NONSTATISTI CAL  TEMPORAL  FILTERS  - FRAME  DIFFERENCING 
1.  Introduction 

Multiple  frame  processing  has  been  actively  developed 
in  the  past  few  years  for  space  surveillance  applications, 
especially  for  those  systems  in  which  the  image  sensors 
platform  is  stabilized  to  cover  the  same  area  for  certain 
periods  of  time.  These  systems  are  generally  known  as  the 
staring,  or  step-staring,  systems.  In  these  systems,  there 
is  a great  deal  of  correlation  of  background  clutter  among 
consecutive  frames  of  images.  A simple  subtraction  of  two 
neighboring  frames  should  eliminate  completely,  in  principle, 
all  background  clutter.  This  is  most  effective  in  revealing 
those  weak  targets  which  are  moving  and  do  not  dwell  in  the 
same  pixel  between  two  frames.  However,  in  real  world  situ- 
ations, sensor  systems  cannot  be  perfectly  stabilized.  Also, 
not  all  background  clutter  is  stationary.  An  example  is 
clouds  which  move.  Consequently,  simple  subtraction  of 
two  neighboring  frames  is  not  adequate  in  many  practical 
applications.  More  involved  subtraction  processes  using 


~,,-l 


several  frames  of  image  have  been  developed.  They  are 
commonly  known  as  the  "Frame  Differencing"  methods  [10]. 

"Single  Differencing"  using  two  frames  ■ 


"Double  Differencing"  using  three  frames: 

F1  ‘ 2F2  * F3  »'CFi  - F2)  - (F2  - F3) 

"Third  Differencing"  using  four  fr&ass: 

F1  - 3F2  ' 3F3  - F4  ' (Fl-2VF5>-(F2-2W 
"Fourth  Differencing"  using  five  frames: 

Fx  - 4F2  ♦ 6F3  - 4F4  ♦ Fs«  (F1-3F2*3F3-F4)  - 

etc.  ’ 0:2-3F3*3F4-F5) 

where  refers  to  the  signal  from  the  same  pixel  from  the 
"i"th  frame. 

These  "frame  differencing"  methods  were  developed 
from  the  simple  concept  that  "non-moving"  clutter  can  be 
cancelled  out  by  frame  to  frame  subtraction.  The  weighting 
factors  for  individual  frames  are  fixed  and  are  independent 
of  the  specific  nature  of  the  images.  Since  the  statistical 
temporal  filters  to  be  developed  in  this  chapter  are  designed 
according  to  the  specific  statistical  properties  of  a given 
set  of  images,  a statistical  analysis  of  the  standard  "frame 
differencing"  techniques  will  be  made  so  that  they  can  be 
compared  with  the  statistical  temporal  filters  developed  in 
this  chapter. 
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2.  Statistical  Analysis  of  First  Differencing  Technique 


Since  the  same  pixel  location  is  used  in  "frame 
differencing"  techniques,  its  coordinate  (m,n)  will  not  be 
used  in  the  following  analysis.  Instead,  a number  k is  used 
to  describe  the  "k"th  frame.  In  the  following  analysis, 
special  attention  is  given  to  the  jitter  problem  which  is 
modeled  by  a random  noise  component  from  frame  to  frame,  i.e., 


where 


x(k+l)  • ax(k)  + Sn(0,l) 


o,S  are  two  constants 


(4-1) 


n(0,l)  s a Gaussian  noise  component  of  zero  mean 
. and  unity  variance 

x(k)  * background  clutter  level  at  a given 
pixel  in  the  k-th  frame 

, x(k+l)  * background  clutter  ievel  at  that  pixel 
in  the  (k+l)-th  frame 

In  eq.  (4-1)  it  is  assumed  that  the  noise  intensity  at  a pixel 
in  the  (k+1)  frame  is  proportional  to  the  intensity  in  the 
same  pixel  at  frame  (k)  with  proportionally  constant  a.  The 
second  term  in  eq.  (4-1)  represents  the  noise  added  to  that 
pixel  due  to  the  sensor  jitter. 

The  constants  a, 8 can  be  rewritten  in  different  forms 
compatible  with  th.e  notation  used  in  the  Markov  model  in 


Appendix  A. 


where 


x(_k+l)  * PKxCk)  + n(0,l) 

a * pK  - temporal  correlation  factor 
2 

8 * oK/l‘pK 

* temporal  standard  deviation. 


(4-2) 
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In  the  following,  the  statistical  properties  of  the 
first  differencing  method  will  be  derived. 

Let  zOO  ■ first  differenced  signal 

- x(k)  - x(k+l) 

- (l-pK)  x (k)  - aK/T^2-n(0,l)  (4-3) 

The  mean  of  z(k)  is  zero  since  x(k)  • x(k-l),  (4-4) 

where  the  symbol  X is  the  expected  value  of  x ,E(x),  taken 
by  averaging  over  the  two  dimensional  image.  The  variance 
of  z(k)  is 

E[z2(k)]  - E((l-pK)2x(k)2  +aK2(l-pK2)  n2  (0,1) 

♦ 2(1-pk)x  (k)oK/l-'pK2  n(0,l)  J 

- (l-pK)2ox2  +«K2(1'pK2)on2  * E[X(K)n(0, 1)  ] ‘constant 

The  last  term  is  zero  because  x(k)  and  n(0,l)  are  assumed  to 
be  uncorrelated  and  since  n(0,l)  has  zero  mean. 

E [ 2 2 (k)  ] - crx2Cl-PK)  2 * aK2U-PK2)an2  * 

Since  the  variance  of  n(0,l)  is  unity, 

E [z2 (k) J - ax2Cl-PK)2  ♦ oK2(l-PK2)  (4-S) 

2 

aK  * temporal  variance 

2 

ox  ■ variance  in  one  frame 
ox  - aK  - o 

E [ t 2 00 J - O2  wCl-p)  C4-6) 


where 


when 
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3.  Figure  of  Merit  for  Frame  Differencin 
Processing  Gain 


A figure  of  merit,  "processing  gain,"  is  defined  to 
describe  the  performance  of  frame  differencing.  The  same 
definition  is  used  for  processing  gain  for  all  filter  tech- 
niques developed  in  this  thesis. 


where 


output  power  signal  to  noise  ratio 
input  power  signal  to  noise  ratio. 


The  "signals"  considered  in  this  thesis  are  point  target  signals 
In  this  chapter,  it  is  assumed  that  these  point  target  signals 
move  at  least  one  pixel  from  one  frame  to  the  next. 


signal  power  in  the  first  frame  pixel  • S 


signal  power  in  the  same  pixel  in  the  second 
frame 


0 because  the  target  has  moved  away 

2 2 

output  signal  power  ■ S.  - S7  ■ S 


Sinput  " input  siSnal  P°wer  * s! 
The  input  noise  power  is 


where 


input  noise  variance 


input  noise  mean  power 


The  output  noise  power  is 


with  zero  mean  as  shown  by  (4-5) 


Therefore,  the  processing  gain  is 


cs/n); 

T mK 


This  "first  differencing"  processing  gain  will  be  used  in 
section  C.2  when  it  is  compared  with  the  processing  gain  of 
statistical  spatial- temporal  filters. 


C.  STATISTICAL  SEQUENTIAL  SPATIAL -TEMPORAL  FILTERS 

In  this  section,  a three  dimensional  statistical  filter 


is  developed.  It  consists  of  a sequential  application  of 
several  spatial  filters  to  successive  frames  of  images  fol- 
lowed by  a temporal  filter  using  these  processed  images.  In 
contrast,  another  three  dimensional  filter  processing  signals 
from  several  frames  of  image  all  at  once  will  be  presented  in 
the  next  section,  0. 
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1.  Filter  Configuration 

The  configuration  of  the  sequential  spatial- temporal 

filter  is  presented  in  Fig.  4-1.  Its  operation  is  described 

as  follows:  K frames  of  images  consist  of  point  targets 

contaminated  by  background  noise. 

% 

Step  I - Spatial  Filters  for  K Frames: 

The  detailed  design  procedure  for  spatial  filters  have 
been  presented  in  Chapter  III.  The  highlights  of  their 
operation  will  be  repeated  here  for  completeness  of  the 
description  of  sequential  spatial- temporal  filters.  > 


[Unprocessed  Signal] 

A two  dimensional  array  of  unprocessed  signals  in  a 
selected  search  box  around  the  estimation  pixel  (m,n)  is 
taken  from  each  frame. 


xll,x12, ’ * ' 

X1,MSB  ; 

X(m,n)  = Xj  => 

x21,x22, • ‘ • 

X2,MSB 

-XNSB , 1 , 

XNSB,MSB- 

(4-10) 


This  two  dimensional  array  of  data  is  represented  by  a 
one  dimensional  vector. 

X * Xj  * [*l,x2,’*'  *i***  (4-11) 

j * MMAX(n-l)  + m 
n * 1, . . . NMAX 
m - 1,...  MMAX 


Three  Frame  Sequential  Statue-Temporal  Filter 


Spatial 
Filter  W 


uuu1 
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Filtered 
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k Frames 


x_  x, 


2)  rz)  <C9> 


r n > 


Temporal^ 
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Spatial -Temporal 
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Xf«  xt  • • • 
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Figure  4-1  Configuration  of  Nonadaptive  Three  Dimensional 
Nonrecursive;  Sequential  Spatial-Temporal  Filter 
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i ■ MSB* (An-1)  ♦ Am 
An  • 1 , . . . ,NSB 
Am  ■ 1, . . . ,MSB 
I - NSB-MSB 


as  presented  in  Fig.  4-2. 

The  unprocessed  signal  X contains  target  signals 

S * [s 1 ,s 2 1 * ■ * *s  I 1 (4-12) 

and  clutter  noise 

N * 1I2  • • • j]  (4-13) 


[Spatial  Filter] 

A linear  two  dimensional  filter  is  described  by  a two 
dimensional  array  of  weighting  coefficients 


W(m,n) 


W11,W12, •* * ,W1 ,MSB 
W21 , w22 , * * * ,W2,MSB 


WNSB,1  ,wNSB,MSBj 


(4-14) 


It  can  be  described  also  by  a one  dimensional  vector 


W - W(i)  - [wx  w2>...,wj]  (4-15) 

These  filter  coefficients  can  be  designed  either  by  the 
minimization  of  mean  square  error  criteria  or  by  the  maximi- 
zation of  signal  to  noise  ratio  criteria. 

[Spatial-Filter  Output] 

The  output  of  the  spatial  filter  is 

y (m,n)  - y » W*XT  (4-16) 


77 


Step  II  - Temporal  Filter: 

[Input  Signal] 

Filtered  signals  at  the  same  pixel  location  (m,n)  of  K 
frames  are  put  together  to  form  the  input  signal  to  the 
temporal  filter. 

Y * tyl,y2,*  **  *yK^  C^-17) 


[Temporal  Filter] 

A linear  one  dimensional  filter  is  described  by  a one 
dimensional  vector. 

WK  - WK(m,n)  » * * • »WKK^  (4-18) 

The  filter  coefficients  are  designed  by  the  same  procedures 
used  for  spatial  filters  by  following  either  the  minimization 
of  mean  square  error  criterion  or  the  maximization  of  signal 
to  noise  ratio  criterion. 


[Combined  Spatial-Temporal  Filter  Output] 

The  final  processed  signal  at  pixel  (m,n)  after  the 
sequential  application  of  K spatial  filters  and  one  temporal 
filter  using  K frames  is  described  by 

z (m,n)  » Y*WkT  (4-19) 

2.  Statistical  Analysis  of  Two  Frame  Sequential 

Spatial -Temporal  Filter 

A statistical  analysis  of  the  two  frame  sequential 
spatial- temporal  filter  will  be  analyzed  first  so  that  it 
can  be  compared  with  the  result  of  the  nonstatistical  first 
differencing  method  analyzed  in  Section  B. 
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The  analysis  of  the  more  general  K frame  sequential  spatial- 
temporal  filters  will  be  presented  in  the  next  section. 


a.  Statistical  Model  of  Two  Frame 
Single  Differencing: 


The  outputs  from  the  spatial  filtering  are 
described  by: 


y(l)  * X(l) ’W1  where  X(l)  denotes  X of  frame  (1) 

y(2)  * X(2)*W^  where  X(2)  denotes  X of  frame  (2) 

In  matrix  form,  they  are 


- 

■ 

m 

y CD 

W 

0 

m 

y (2) 

M 

0 

w 

foLL 

r't. 


X (2) 


(4-20) 


To  calculate  the  noise  power  of  the  final  output,  the 
covariance  of  the  spatial  filtered  image,  RYY,  is  needed. 
Using  (4-20) : 


Ryy  - E [Y 1 • Y] 


* 

w 

0 

0 

w 

w 

0 

0 

w 

R^d.l) 


,XXC2,D 


.XXC2.2)( 


V 

0 

0 

(4-21) 


where  Rxx(i.j)  * E[XT(.i)X(j)]  * covariance  of  [X]  (4-22) 

It  is  assumed  that  both  X and  Y have  zero  mean  and  that  frame 
(1)  and  frame  (2)  statistical  properties  are  the  same. 
Therefore: 


"xxCi.D  * Rxx(2,2) 


XX 


(4-23) 


1 


• m 

- - 

- 

— 

X*(l) 

X(1) 

WT 

0 

XT(2) 

X(2) 

0 

7 

J 

1 
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Using  the  first  order  Markov  model,  as  in  section 
IV. B. 2,  (4*2)  the  temporal  statistical  characteristics  are: 


XTC2)  - PKI-XT(1)  + I«ok/T^pk2  n(0,l)  (4-24) 

where  I is  the  unity  matrix. 


Multiplying  (4-24)  by  X(l)  and  taking  the  expected  value 
yields : 

E [XT  (2)  *X(1)  ] = E{  [pKI  XT(1)  + I aK/T^K2  n(0,l)]X(l)> 
Rxx(2,l)  - pk*E[XT(1)X(1)  ] + I aK/T^K2  n( 0,1) X(l) 

(4-25) 


The  second  term  is  zero  since  n is  Gaussian  with  zero 
mean  and  is  not  correlated  with  X(l).  Therefore, 

Rxx(2,l)  - R^U.2)  = PKE[XT(1)X(1)]  =■  PkRxx  (4-26) 


Substituting  back  into  (4-21), 


YY 


w 

0 

Rxx 

pkrxx 

1 

H 

0 

0 

w 

fxRxx 

Rxx. 

LH 

T 

w1 

m 

1 

f 


W Rvv  W 


XX 


P„W  Rxx  W1 


PKW  RXXW' 


W Rxx  WJ 


(4-27) 


T 2 

W Rxx  W*  - Oy  is  the  noise  variance  of  spatial 


filtered  images  since 


J 
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Therefore, 

RYY 


E[yy]  3 E[CWXT)  CWXT)]  = E[W*XT'X*WT) 
W*E[XT*X]*WT  » w*Rxx^t 


(4-28) 


b.  Statistical  Analysis  of  Two  Frame 
Single  Differencing 

The  temporal  filter  used  in  this  analysis  is  the 
simple  first  differencing  operation,  so  that  the  temporal 
filtered  output  is: 


W = [1,-1] 

[y  (1)1  T 

z = [1,-lj-  y(2J  3 y(l)  - y(2)  * $VK  Y1  (4-29) 

The  variance  of  z is: 

# z2  - E [z2]  = E[Wk*YT«  Y*WkT]  = WkE[YT*Y]WkT  (4-30) 

Substituting  (4-28)  into  (4-30)  will  yield: _ 
oz2  3 wk*RYY‘Wk'=5  [ 1 » ~ 1 3 ay" 

= aY22(l-pK)  (4-31) 


It  can  be  shown  that  the  same  result  is  true  for 
a sequential  filter  by  applying  first  the  temporal  differencing 
followed  by  the  spatial  filtering. 
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processing  gains  whereas  the  temporal  differencing  alone 
possesses  only  the  PG  related  to  the  second  term  in  eq.  (4-32) 
3.  Statistical  Analysis  of  K Frame  Sequential 


In  this  section,  a more  general  K frame  sequential 
spatial- temporal  filter  is  analyzed.  In  this  case,  the 
temporal  filter  used  is  designed  by  a statistical  process 
instead  of  the  nonstatistical  "first  differencing"  temporal 
filter  used  in  the  previous  section. 

a.  Statistical  Analysis  of  Spatial  Filters 
of  Different  Frames 


The  input  temporal  signal  from  K successive  frames 
is  described  by  spatially  filtered  output  Y where: 


which  results  from  applying  spatial  filters  to  K frames  of 
unprocessed  signal  X. 


Again,  the  covariance  of  Y is  needed  for  calculating  the  noise 
power  of  the  images  processed  by  the  spatial  filters. 


If  we  assume  Y has  zero  mean, 


*YY  ’ 

Covariance  f YJ  • E[YT»Y]  ■ E[W*XT»X*WT] 

"»T  ••  *»T 

- W* E [X1 »X] W1 

• * Rxx  ftT 


(4-35) 


The  same  first  order  Markov  model  is  used  for  the  correlation 
of  two  successive  frames. 

XT(K)  - pkIXT(K-1)  + I aK/TTTpK2  n(0, 1) 


Therefore,  similar  to  eqs . (4-25)  and  (4-26), 
E[XT(K)*X(K-1)]  - pk  Rxx 
Similarly,  it  can  be  shown  that 

E[XT(K)  X (K- 2) ] - pK2  Rxx 


(4-36) 


In  general. 


E [XT (K)  X (K-j)]  - PKj  Rxx 


(4-37) 


Substituting  (4-37)  into  (4-35)  and  using  the  following 


two  relations  - 


PKRXX  PKRXX  * ’ PK  1 RXX 


RyY  . W • PKRXX  RXX  pkrxx 


P K*2  R 

mk  kxx 


PK  1 **XX 


(4-38) 


<Jy2  • W*RxxWT  ■ variance  of  spatial  filtered  image. 
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Rn  m °y 


PK 

1 


, 4-1 1 

or 

p 2 DPK 

^Yy  * ^y  ^yy 


(4-38) 


b.  Statistical  Analysis  of  Temporal  Filters 

Similar  to  the  spatial  filter  cases  in  Chapter 
III,  two  statistical  criteria  can  be  applied  to  design  the 
temporal  filter. 

If  the  minimization  of  mean  square  error  criterion 

is  used, 

WK  - [R^r1  PK  (4-39) 

where  RYYK  - ♦ RSSK 

RNNK  " covariance  [N^] 

RSSK  * covariance  [SK] 

PK  - E[Y.Sk] 

As  before,  target  signal  and  clutter  noise  are 
assumed  to  be  uncorrelated. 

If  the  maximization  of  signal  to  noise  ratio 
criterion  is  used, 

WK  ■ C(WV  '4-40’ 
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where  C ■ selected  constant 

SK  • target  signal  vector  in  the  same  pixel  along 


K frames 

[SK1,SK2,‘  *sKk/  ,SKK] 


where  k ■ 1,  2,  . . . K 


The  final  output  of  the  sequential  spatial- temporal  filter 


z * Y*  W» 


The  noise  output  power  of  z is  given  by 


Z * wk-ryy-wkT  ■ V&V  "y2 


c.  Processing  Gain 


(4-41) 


Assuming  again  that  the  target  signals  move  at 
least  one  pixel  from  one  frame  to  the  next  - 

sout  ■ VSK 

where  SK  ■ [0 , 0 , . . . s , 000 . . ] for  a moving  point  target, 
In  most  applications  of  point  target  detection, 

sout  ■ S ■ 5in 

2 2 
N^n  - one  frame  input  noise  power  - o 

2 

* output  noise  power  after  multiple  frame 
out  filtering  - a* 


CS/Nj  Q 
CS/N)2. 


S2 

oj  a,2 

~7T  " 
i-2  az 


C4-42) 
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sz . x: 


where  a*  "wk*ryy*  WK  * 0 y * V RYY*  WK 
ay2  - W-R^W1  » ox2  *W*Rxx'WT 


az2  - ax2  [W-RXX*wTl  [WK*RYY*WKT  1 


Finally, 


PG 


(W.  Rxx- W*)  (Wv-  R&*- WrT) 


K YY  K 


(4-43) 


(PG  of  spatial  filter) (PG  of  temporal  filter) 


D.  AN  EFFECTIVE  WAY  OF  HARDWARE  IMPLEMENTATION 
OF  SEQUENTIAL  SPATIAL- TEMPORAL  FILTER 

In  the  previous  section,  a special  class  of  a three 

dimensional  spatial- temporal  filter  was  developed  in  which 

nonrecursive  spatial  filtering  and  nonrecursive  temporal  filter 

were  carried  out  sequentially.  They  are  described  by  the 

following  operations. 


I 

y(l)  - Z x(i,l)w(i,l)  - X(l)  W 
ial 

y (2)  =*  I1  x (i , 2) w(i , 2)  = X ( 2)  W 
i3l 


Spatial 


I T 

yCK)  ».Z1xCi,K)w(i,K)  - X(K)  W1 

2 VV111"*'1)  ■ Y wkT 


Temporal 


In  general  form, 
K 


MSB  NSB 


■ Z wv(k)  Z Z w(m,n)x(m,n) 
^■1  tn-1  n*l 
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This  type  of  nonrecursive  processing  requires  the  memory  of 
all  K frames  of  image  data. 

It  might  be  possible  to  implement  this  type  of  three 
dimensional  filter  by  only  using  one  frame  of  memory  and 
updating  its  signals  in  a recursive  manner  as  follows: 

MSB  NSB 

z(k)  ■ z(k-l)  ♦ wv(k)  E E w(m,n)x(m,n) 

m«l  n-1 

This  approach  of  combining  a recursive  implementation  of 
nonrecursive  temporal  filter  with  nonrecursive  spatial  filter 
could  be  used  when  the  temporal  filter  is  designed  by  other 
criteria,  such  as  by  the  Kalman  filter  approach,  instead  of 
the  MMSE  filter  and  matched  filter  approaches  developed  in 
this  thesis.  This  recursive  approach  is  suggested  as  a method 
to  be  developed  in  possible  future  woTk. 

E.  COMPUTER  SIMULATION  PROCEDURE  FOR  EVALUATING 

SEQUENTIAL  SPATIAL -TEMPORAL  FILTERS 

The  three  dimensional  sequential  spatial- temporal  filters 
have  been  evaluated  by  computer  simulation  using  two  types  of 
images : 

a.  Simulated  images  using  Markov  model  clutter  noise 

b.  A real  world  infrared  image. 

The  results  will  be  presented  in  detail  in  Chapter  VI.  In 
the  following,  software  procedures  for  evaluation  of  these 
two  types  of  images  will  be  presented. 
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1.  Markov  Model  Simulated  Images 

The  following  steps  are  used. 

a.  Generate  a two  dimensional  stochastic  field  with 
specified  statistical  properties  to  simulate  the  background 
clutter  (Appendix  A) . 

b.  Add  a set  of  targets  in  the  clutter  to  form  an 

image . 

c.  Generate  K frames  of  images  with  specified  temporal 
statistical  properties. 

d.  Design  spatial  filter  and  then  temporal 
filters  according  to  either  MMSE  or  matched  filter  criteria, 
optimized  to  the  assumed  clutter  statistics  and  target  char- 
acteristics . 

e.  Apply  sequentially  the  spatial  filter  and  temporal 
filter  to  suppress  the  clutter  and  to  enhance  the  targets  and 
evaluate  the  processing  gain. 

f.  Calculate  a threshold  setting  according  to  a spec- 
ified probability  of  false  alarm  assuming  that  the  probability 
density  function  of  the  filtered  image  is  Gaussian. 

g.  Apply  the  threshold  to  separate  targets  from 
residual  clutter. 

2 . Real  World  Infrared  Images  of  Background  Clutter 

Because  the  statistical  properties  are  inherent  in 

the  images,  no  computer  simulated  clutter  is  needed.  The 
following  steps  are  used. 
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spatial  properties  such  as  mean,  variance,  probability  density 
function  and  covariance  matrix.  The  exact  calculation  method 


is  presented  in  Ref.  [30] . 

b.  Design  statistical  spatial  filters  according  to 
either  the  MMSE  filter  criterion  or  the  matched  filter  criterion 


c.  Add  a set  of  targets  to  the  given  infrared  images 

d.  Apply  the  spatial  filter,  evaluate  the  processing 
gain,  and  store  the  processed  k-th  frame.  The  detailed  pro- 
cedure can  be  found  in  Ref.  [30] . 

e.  Repeat  steps  (a)  to  (d)  for  all  the  K frames. 

f.  Calculate  the  statistical  temporal  properties  of 
selected  pixel  locations  from  all  K frames  of  spatially 
filtered  data. 


g.  Design  a statistical  temporal  filter  according  to 
either  the  MMSE  filter  criterion  or  the  matched  filter  criterion 


h.  Apply  the  temporal  filter,  calculate  the  mean  and 
the  variance  of  the  filtered  image  am  evaluate  the  processing 


gain.  i 

i.  Calculate  a threshold  setting  for  a specified 
probability  of  false  alarm  using  the  method  to  be  described 
in  Chapter  V because  the  probability  density  function  is 
generally  non-Gaussian. 

j.  Apply  the  threshold  to  separate  targets,  false 
alarms  from  residual  clutter  noise. 
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F . SUMMARY 

Three  dimensional  focal  plane  processing  methods  are  very 
effective  in  background  clutter  suppression  because  the  pro- 
cessing gains  of  spatial  and  temporal  filters  are  multiplica- 
tive. A combination  of  spatial  and  temporal  filtering  should 
always  improve  the  total  processing  gain.  Furthermore,  if 
the  temporal  clutter  noise  is  highly  correlated,  which  usually 
is  true  if  the  drift  and/or  jitter  between  successive  frames 
is  small,  the  processing  gain  of  a temporal  filter  is  usually 
higher  than  that  of  the  spatial  filters.  An  example  will  be 
presented  in  Section  F of  Chapter  VI. 

In  this  chapter,  the  configuration,  design  procedure  and 
performance  analysis  of  nonstatistical  "frame  differencing" 
temporal  filters  developed  elsewhere  [10]  were  first  presented, 
followed  by  the  sequential  statistical  spatial- temporal  filters 
developed  in  this  thesis.  It  was  found  that  the  sequential 
spatial  temporal  filtering  technique,  when  applied  on  real  IR 
images,  offers  indeed  superior  processing  gain  compared  to 
either  spatial  filtering  or  frame  differencing. 
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V.  TARGET  DETECTION  IN  FOCAL  PLANE  PROCESSING 
A.  INTRODUCTION 

In  most  infrared  images,  targets  are  deeply  buried  in 
noise  which  consists  of  strong  background  clutter  noise  and 
other  random  noise.  The  targets  can  be  as  weak  as  70  to  80 
db  below  clutter.  Predetection  processing  must  be  used  to 
suppress  the  clutter  to  the  point  that  "target"  signal  to 
"clutter"  noise  ratio  is  adequate  for  target  detection.  This 
was  discussed  in  Chapters  III  and  IV. 

Target  detection  usually  consists  of  several  steps.  The 
first  step  is  "thresholding"  which  is  the  subject  of  this 
chapter.  This  is  used  to  separate  targets  from  noise  remain- 
ing after  the  predetection  processing.  Since  both  target 
signals  and  noise  after  filtering  are  statistical  quantities, 
it  is  generally  difficult  to  clearly  separate  targets  from 
noise  except  in  rare  occasions  when  the  signal  to  noise  ratio 
is  very  high.  In  most  cases,  the  intensities  of  targets  and 
noise  overlap.  Any  selection  of  threshold  will  miss  some 
targets  and  include  some  noise  (false  alarms).  There  is 
always  a compromise  between  a complete  detection  of  targets 
by  using  a low  threshold  at  the  expense  of  including  many 
false  alarms,  and  a complete  elimination  of  false  alarms  by 
using  a high  threshold  but  at  the  expense  of  missing  many  of 
the  targets.  Two  figures  of  merit  are  normally  defined  to 
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describe  the  false  alarm  and  target  detection.  They  are  the 
probability  of  false  alarm  CpFA)  and  probability  of  detection 

CPD)  • 

A target  detection  process  involves  five  types  of  related 
information: 

1.  The  PDF  of  filtered  targets  and  noise  (PDF  is  probability 
density  function) 

2.  Signal  to  noise  ratio  - SNR 

3.  Threshold  level 

4.  PFa 

5.  PD 

Their  relationships  to  detection  have  been  very  well  developed 
in  radar,  sonar  and  elsewhere  [31-33].  In  this  chapter,  the 
one  dimensional  detection  procedure  is  extended  in  a straight- 
forward way  to  two  dimensions  for  application  to  focal  plane 
processing  problems. 

B.  PREDETECTION  FOCAL  PLANE  PROCESSING  FOR  CLUTTER  SUPPRESSION 
Clutter  suppression  is  one  of  the  most  important  processing 
steps  before  the  thresholding  for  target  detection.  Statis- 
tical spatial  filter  and  spatial-temporal  filters  have  been 
developed  in  Chapters  III  and  IV  respectively.  Their  impor- 
tant steps  and  statistical  descriptions  will  be  reviewed  and 
summarized  in  this  section. 

1 . Statistical  Properties  of  Unprocessed  Image 

The  unprocessed  image  data  taken  from  a two  dimensional 
detector  array  of  Am  x An  pixels  are  described  by: 
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X11,X21  * * ’ XMSB, 1 
• • 

X - 

• • 

X1,NSB  ‘ • • XMSB , NSB 

In  this  study,  this  two  dimensional  array  is  written  as  a 
one  dimensional  vector  for  ease  of  programming  in  processing 
software. 

X - X(i)  - Cxi ,x2 , • • • xj]  (5-1) 

where  i a MSB* (An- 1)  + Am  Am=l , 2 , . . . .MSB 

An*l , 2 NSB 

This  transformation  was  previously  presented  in  Fig.  3-2. 

The  unprocessed  image  is  considered  to  be  the  sum  of  target 
signals 

S * S (i)  a [sx  S£  •••»  Sj]  (5-2) 

and  background  clutter  noise 

N - N(i)  - [n^  n2  •••»  nj]  (5-3) 

Target  signals  can  be  either  deterministic  or 
statistical.  It  is  assumed  that  their  spatial  shapes  are 
deterministic  such  as  point  target orline  targets  of  various 
orientations.  Their  intensity  amplitudes  may  be  deterministic 
or  statistical  with  Gaussian  probability  density  functions 
assumed.  Deterministic  targets  are  described  by  the  vector  - 

S * tsl,s2,  ‘ * * » SIJ 
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Statistical  targets  are  described  by  several 
statistical  characteristics: 


Mean  vector  ■ Wg  - 

twSl,uS2,’ * ,uSl^ 

(5-4) 

Covariance  matrix  * 

Rss  - E[(ST-ygT)(S-ys)] 

(5-5) 

Variance  * Og2 

(5-6) 

Autocorrelation  function  = Qg 

(5-7) 

The  background  clutter  is  statistical  and  described 


by  the  following  characteristics: 

Mean  vector  =*  uN  - [PN1>PN2>  * * *^1^  (5-8) 

T T 

Covariance  matrix  * R^N  = E [ (N  - uN  ) (N  - y^)  ] (5-9) 

2 

Variance  ■ crN  (5-10) 

Autocorrelation  function  = (5-11) 


In  computer  simulated  images,  the  clutter  noise  is 
described  by  either  the  first  order  or  the  second  order 
Markov  models  described  in  Appendix  A,  and  the  PDF  is 
assumed  to  be  Gaussian. 

2 . Single  Frame  Processing  - Nonrecursive 
Statistical  Spatial  Filters 

Two  nonrecursive  statistical  linear  spatial  filters 
were  developed  to  process  the  image  signal  X. 

The  filter  is  described  by  its  filter  coefficient 

vector: 
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The  coefficients  can  be  designed  by  two  criteria.  A 
minimization  of  mean  square  error  led  to  the  spatial  MMSE 
(or  Wiener)  filter.  A maximization  of  output  signal  to  noise 
ratio  led  to  the  spatial  matched  filter. 

The  filtered  output  is  described  by: 


which  contains  both  the  filtered  target  signal  y-  and  filtered 


clutter  noise 


The  filtered  statistical  targets  are  described  by  the 
following  statistical  characteristics: 


Mean 


Variance  » a 


The  filtered  deterministic  targets  are  simply  described 
by  their  intensities. 


The  filtered  clutter  noise  is  described  by  the  follow 
ing  statistical  characteristics: 


Mean 


Variance 


n 


3 . Multiple  Frame  Processing  - Nonrecursive 
Statistical  Spatial-Temporal  Filters 

In  multiple  frame  processing,  a one  dimensional 
temporal  filter  W K is  added  to  the  two  dimensional  spatial 
filters  W.  In  this  thesis,  spatial  filtering  is  performed 
first  on  several  frames  of  images.  It  is  then  followed  by 
temporal  filtering  of  the  spatial-f iltered  images  using  sig- 
nals from  the  same  pixel  location  from  several  consecutive 
frames.  This  set  of  time-varying  signals  is  described  by 
the  vector 

YK  * lyl,y2, ' ’ *yK^  (5- 19) 

Yk  consists  of  target  signals  - 

SK  " ^SK1 , SK2 , ’ ‘ ,SKKJ  (5-20) 

and  correlated  temporal  noise  - 

NK  ’ (nKl,nK2,---nKK1  (5'21) 

In  the  computer  simulations  reported  later,  only  the  first  order 
Markov  model  is  used  for  correlated  temporal  noise.  The 
temporal  filter  is  described  by: 

WK  " twKl,WK2,* * ,WKK^  (5-22) 

The  output  spatial-temporal  filtered  image  is  described 
by: 

2 - Yk*WkT  (5-23) 

Again,  z also  has  its  target  components  and  clutter  noise 
components. 
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The  spatial-temporal  filtered  target  signals  are 
described  by: 

The  signal  intensity  • zs  ■ (5-24) 

for  deterministic  targets.  For  statistical  targets,  they 
are  described  by: 

Mean  • utg  ■ ( S - 2 S) 

Variance  - otg  • WK*RSSK*WKT  (5-26) 

C.  TARGET  DETECTION  IN  FOCAL  PLANE  PROCESSING 

Two  methods  of  calculating  threshold  level  are  investi- 
gated. 

1)  CFAR  (constant  false  alarm  rate) 


1.  CFaR 

In  the  CFAR  approach,  the  threshold  level  • VTH  is 
selected  such  that  PfA  is  constant.  It  is  important  in  many 
practical  military  applications  because  a system  will  operate 
for  a long  time  without  any  target  being  present,  facing 
mostly  background  clutter  noise.  It  is  important  to  know 
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the  expected  false  alarm  rate  and  keep  it  constant.  Two 
methods  of  setting  will  be  presented, 
a.  Gaussian  PDF  Case 

When  the  PDF  of  the  filtered  noise  (denoted  by 
P(u))  is  Gaussian,  as  shown  in  figure  5-1,  the 
threshold  level  VTH  can  be  calculated  analytically  as  follows 


P(u)du  (S- 27) 


as  shown  in  Fig.  5-1  by  the  shaave  area 
u denotes  noise  variable 


Since  P(u)  is  a PDF,  the  first  term  is  1.  The  second  term 
is  the  normal  cumulative  distribution  function  F(u)  which  is 
tabulated  or  can  be  computed  using  standard  computer  routines 


This  threshold  equation  is 


ou  can  be  found  from  ou  which  is  the  variance  of  the 
filtered  noise  given  by  (5-18)  for  the  spatial  filter  case 
and  by  (5-26)  for  the  spatial- temporal  filter  case.  uu  is 
the  mean  of  the  filtered  noise  given  by  (5-17)  for  the 
spatial  filter  case  and  by  (5-25)  for  the  spatial- temporal 
filter  case. 


is  proportional  to  the  standard  deviation  of  the  filtered 
noise  for  a specified  Pp^.  For  CFAR  requirements,  the  setting 
of  VTH  is  equivalent  to  finding  the  constant  K. 


b.  Non-Gaussian  PDF  Case 

In  real  world  situations,  it  was  found  that  the 

PDF  of  clutter  intensity  is  Usually  non-Gaussian.  A typical 

example  is  shown  in  Fig.  5-2  which  contains  normalized 

histograms  of  real  world  infrared  scene. 

Fig.  5-2(a)  -"APDF"  of  unprocessed  image  ("APDF'  is  approximated  PDF) 

Fig.  5-2(b)  -"APDF"  of  spatial - f iltered  image 

Fig.  5-2(c)  -"APDF"  of  spatial-temporal  filtered  image. 

The  "APDF'  is  achieved  by  evaluation  of  each  pixel  intensity 
and  counting  all  pixels  with  approximately  the  same  intensity 
so  as  to  achieve  the  histogram.  The  histogram  is  then  normal- 
ized so  that  the  total  area  under  the  curve  becomes  1 so  as 


to  yield  the  approximated  PDF. 

It  can  be  seen  that  the  mean  of  the  filtered  scene 
can  be  approximated  by  zero,  and  also  that  none  of  these  "APDFs" 
are  Gaussian. 

For  these  cases,  a numerical  algorithm  is  devel- 
oped  to  set  the  threshold  for  a specified  Pp^,  or  CFAR.  The 
basic  assumptions  are  the  following: 


5* 


PDF  of 

unprocessed 

image 


a)  The  "APDF’  of  filtered  image  is  available  but  cannot  be 
expressed  in  terms  of  an  explicit  analytical  function. 


b)  The  mean  of  the  filtered  image  is  zero. 


c)  Similar  to  the  Gaussian  PDF  case,  the  threshold  level 
is  given  by: 


VTU  * K»o„  (a  is  standard  deviation 
rH  u u of  filtered  image) 


K is  to  be  determined  by  a computational  procedure  whose 


flow  chart  is  shown  in  Fig.  S-3(a)(b).  The  false  alarm  rate 


can  be  shown  to  be  indeed  constant  for  a given  K considering 


the  following: 


P FA  " C P (u)du 
A VTH 


(5-30) 


where  p(u)  is  any  given  PDF.  The  threshold  level  is  selected 


to  be 


VTH  " K** 


(5-31) 


where 


+ QD 

■}  -> 


r * • f u“p(u)*du  » C,  (assuming  u has  zero  mean) 

1 (5-32) 


If  we  select  C2  so  that  o ■ ■ C2  and  substitute  eq. 

(5-23)  into  eq.  (5-22),  the  PpA  for  a given  K is: 


K«constant 


■ / p(u)du  ■ constant  ■ C.  (5-33) 

K*C2 


Eq.  (5-25)  shows  that  for  a given  K,  PpA  is  constant,  yielding 
the  CFAR  algorithm.  In  general,  PFA  is  a function  of  K and 
can  be  expressed  as  PpA(K). 
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Given  the 

filtered 

ijMge 


Generate 

PFA(K) 

vector 


Select  PFA. 
Find  K 
fra*  vector 


Set 

threshold 
Vtli  ■ K«c,, 


Figure  5-3(a)  Procedure  for  Setting  Threshold  in  Cases 

of  Non-Gaussian  Probability  Density  Function 


Figure  5- 3(b)  Flow  Chart  for  Generating  PFA  versus  K Curve 
Used  in  Setting  Threshold 


The  only  nontrivial  step  in  this  flow  chart  is 
step  3 where  we  generate  a vector  (or  table  look  up)  which 


1 

i 


■ u 


relates  K to  PpA  (vector  PpA(K)]  for  a given  ou  and  unknown 
PDF.  Figure  5-4  is  a typical  plot  of  such  a table  look  up 
for  Gaussian  PDF.  In  Fig.  5-5,  the  vector  PpA(K)  will  con- 
tain data  similar  to  Fig.  5-4  but  for  the  unknown  PDF.  To 
perform  step  4,  a PfA  has  to  be  specified  and  then  the  vector 
Pp^(K)  will  be  searched  (left  to  right)  to  find  the  first  K 
to  yield  Pp^  Pp^  (specified) . 

2 . Bayes  Criterion 

Bayes  criterion  is  another  method  of  threshold  setting 
based  on  a priori  knowledge  of  the  target  as  well  as  the  noise. 
The  basic  disadvantage  of  this  method,  compared  with  the  CFAR 
approach,  is  the  requirement  to  specify  the  target,  background 
clutter  and  their  statistical  properties.  However,  if  this 
information  is  already  available,  the  Bayes  criterion  can  be 
useful.  Otherwise,  the  CFAR  approach  is  more  useful.  The 
Bayes  criterion  is  described  in  detail  in  Appendix  B. 

3.  Probability  of  Detection 
a.  Introduction 

If  the  probability  density  function  (PDF)  of  the 
target  and  also  the  noise  are  known,  the  probability  of  detec- 
tion (P^)  can  be  calculated  in  a straightforward  manner.  It 
should  be  emphasised  that  the  clutter  noise  considered  in  the 
calculation  of  Pd  is,  in  most  cases,  not  the  unfiltered 
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Figure  5*9  Probability  Density  Function  of  Signal  + Noise 

(a)  Target  Signals 

(b)  Noise 

(c)  Targets  and  Noise 


Figure  5-10  Calculation  of  Probability  of 
Detection 


r 

i i 

clutter,  but  the  filtered  clutter  noise.  Because  in  the 
unfiltered  condition  intensities  of  targets  are  usually  only 
a small  fraction  of  the  clutter  intensity,  the  threshold 
should  not  be  applied  at  this  stage.  Only  in  limited  cases 
is  target  intensity  sufficiently  higher  than  the  clutter  so 
that  a threshold  can  be  applied  without  any  predetection 
processing. 

Two  methods  of  calculating  the  P^  are  implemented 
in  this  thesis.  The  first  method  is  analytical  and  only 
applies  to  the  special  cases  when  the  PDF  is  either  Gaussian 
or  can  be  explicitly  described  by  mathematical  expressions. 
The  second  method  is  numerical  and  is  applicable  to  any  case, 
regardless  of  whether  or  not  the  PDF  can  be  described  by  well 
known  functions.  This  method  is  implemented  in  the  computer 
simulation  by  counting  the  detected  targets  and  comparing 
their  number  with  the  number  of  inserted  targets, 
b.  Gaussian  PDF  Case 

If  the  PDF  of  the  clutter  noise  is  Gaussian,  the 
PDF  of  the  processed  clutter  by  any  linear  filter  is  also 
Gaussian,  as  shown  in  Fig.  5-9(b).  Target  signals  considered 
in  this  thesis  can  be  either  deterministic  or  statistical,  as 
shown  in  Fig.  5-9(a).  Assuming  the  signal  and  noise  are 
uncorrelated,  then 

PDF(s+n)  ■ PDF^*PDF^  is  also  Gaussian  (.5-34) 

where  * denotes  convolution.  A typical  result  is  shown  in 
Fig.  5-9(c).  The  resultant  statistical  properties  are: 
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w S+N 


mean  of  signal  ♦ noise 


(S-3S) 


- us  ♦ uN  - 

2 2 2 

°S+N  " °S  * °N  * varianc®  signal  ♦ noise 

The  mean  and  the  variance  have  been  calculated 
in  Chapter  V,  section  B. 

For  a selected  threshold  V^H,  the  probability 
of  detection  is  given  by  the  shaded  area  in  Fig.  5-10  and 
can  be  determined  by  the  following  integration: 


00 

/ 


UrH  SR  as+N 


exp  [ - J ( 


]dx 

rS  + N 


% 


N) 


P 


d 


1 - F ( 


VTH~US+N  . 
°S+N 


(5-36  ) 


x 

where  F(X)  • / N(0,l)dn 

-CO 


■ normal  cumulative  distribution  function. 

F(X)  can  be  easily  evaluated  by  using  the  error  function 
routine  available  in  most  computer  libraries  because 

erf (X)  • 2F(/73c)-l  (S-37) 

c.  Non-Gaussian  PDF  Case,  P^ 

If  the  PDF  of  the  unprocessed  clutter  noise  is 
other  than  Gaussian,  the  PDF  of  the  processed  clutter  is 
generally  not  Gaussian.  The  processed  clutters  PDF  can  be 
obtained  wither  analytically  or  by  a best  fit  algorithm,  and 
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the  PDF  of  the  processed  signal  plus  clutter  can  be  obtained 

as  well.  Denoting  the  PDF  of  clutter  as  P(N)  and  the  PDF  of 

signal  plus  clutter  as  P(S+N),  the  resulting  probability  of 

00 

detection  is  given  by  Pj  ■ / P(S>N)d(S  N) . 

a v ~ 

VTH 

D.  SUMMARY 

Three  major  steps  in  target  detection  are  discussed  in 
this  chapter.  First,  the  probability  density  function  (PDF) 
of  both  filtered  image  and  target  signals  are  determined. 

Next,  based  on  the  PDF,  a threshold  can  be  calculated  for 
any  specified  probability  of  false  alarm.  Third,  from  the 
threshold,  the  probability  of  detection  can  also  be  calculated 
using  the  known  PDF. 

If  the  PDF  of  filtered  clutter  noise  is  Gaussian,  both 
the  threshold  and  Pd  can  be  theoretically  determined.  Other- 
wise, they  must  be  numerically  calculated  using  the  known 
PDF.  Topical  results  based  on  computer  simulations  will  be 
presented  in  Chapter  VI  where  predetection  processing  using 
statistical  spatial  filters  and  temporal- spatial  filters  for 
clutter  suppression  will  be  combined  with  thresholding  for 
target  detection.  Both  computer  simulated  images  containing 
Markov  model  clutter  noise  and  a real  world  infrared  back- 
ground image  will  be  used  to  test  the  results  of  focal  plane 
processing. 

1 
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VI.  PROPERTIES  AND  PERFORMANCE  OF  NQNADAPTIVE 

SIAIIS.7ICAL  F.QCAL  ELAMS  PROCESSING  - 
NQNREOJ.RSiyEjILTEftS_.EQR  CLUTTER  SUPPRESSION 
FOLLOWED  _BY  _ THRESHOLDING  FOR  TARGET  DETECTION 


A.  INTRODUCTION 

Focal  plane  processing  consists  of  many  steps.  It  is 
started  at  the  optical  detectors.  After  detection,  multi- 
plexing and  signal  conditioning,  the  first  two  steps  are 
clutter  suppression  and  thresholding.  Following  these,  image 
enhancement  techniques  may  be  used  to  improve  the  shapes  and 
features  of  targets,  linking  procedures  may  be  used  to  con- 
nect moving  point  targets  from  many  frames  to  form  tracks  in 
what  is  sometimes  known  as  the  "track  association"  or  "track 
assembly"  processing,  trajectory  estimation  techniques  may 
be  used  to  determine  the  dynamics  such  as  velocity  and 
acceleration  of  the  targets,  pattern  recognition  and  discrim- 
ination techniques  may  be  used  to  obtain  more  information  on 
the  targets.  All  of  these  additional  processing  techniques 
can  be  used  to  distinguish  true  targets  from  false  alarms. 
However,  this  thesis  is  concerned  only  with  the  first  two 
steps  - background  clutter  suppression  and  thresholding. 

In  previous  chapters,  the  principles  and  design  proced- 
ures for  four  focal  plane  processing  procedures  have  been 
developed. 
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0 For  background  clutter  suppression: 

Chapter  III  - Single  frame  focal  plane  processing: 
MMSE  filters 
Matched  filters 

Chapter  IV  - Multiple  frame  focal  plane  processing: 
MMSE  filters 
Matched  filters 

0 For  initiation  of  target  detection: 

Chapter  V - Thresholding 

In  this  chapter,  quantitative  results  of  these  focal 
plane  processing  procedures  will  be  investigated  and  analyzed 
in  more  detail.  The  organization  of  results  of  computer 
simulated  analysis  and  tests  are  described  in  the  following 
section. 

B.  ORGANIZATION  OF  COMPUTER  SIMULATED  STUDIES 

1 . Types  of  Focal  Plane  Processing  Procedures 

Four  focal  plane  processing  procedures  have  been 
developed,  as  listed  above.  Two  are  spatial  filters  which 
use  one  frame  of  an  image.  Two  are  spatial- temporal  filters 
which  use  several  frames  of  images.  Each  of  these  filters 
is  followed  by  a thresholding  step. 

The  important  features  of  these  filters  are: 
a.  For  spatial  filters: 

0 3x3  search  box 
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1 0 Estimation  point  is  in  the  center  of  the  box 

in  most  cases.  It  is  moved  to  the  edge  or 
corner  of  the  search  box  when  the  estimation 
point  is  along  the  edges  or  corners  of  an  image. 

° Point  targets  are  considered  in  almost  all  cases, 
b.  For  temporal  filters: 

° One  pixel  from  three  or  five  successive  frames. 

° Estimation  point  is  in  the  middle  of  successive 
frames.  Example:  second  frame  for  a 3 frame 
temporal  filter,  third  frame  for  a 5 frame 
temporal  filter. 

0 Point  targets  are  considered  which  move  at 
least  one  pixel  from  one  frame  to  the  next. 

1 2.  Types  of  Images  Used  in  Computer  Simulation 

Two  classes  of  images  are  used, 
a.  Computer  Generated  Images 

Unprocessed  images  are  generated  by  computer 
simulation  and  contain  three  components: 

(1)  Targets  - Mostly  point  targets,  described 
by  their  locations  and  intensity. 

(_2)  Uncorrelated  random  noise  is  described  by 

2 

its  mean,  which  is  usually  zero,  and  variance  a^N  . 

C3)  Correlated  random  noise  - Two  types  of  Markov 
processes  are  used  to  describe  correlated  random  noise.  The 
detailed  theoretical  model  analysis  is  presented  in  Appendix  A. 


First  order:  Q(m,n)  ■ o^N  P^Py1^ 

Second  order:  Q(m,n)  ■ o^N  ^ p|n ^ cos (BH*m)cos  (By*  n) 

It  can  be  seen  that  three  parameters  are  needed  to 
describe  the  first  order  Markov  model. 

aCN  " vari-anc*  correlated  noise 
PH  - horizontal  correlation  factor 
py  ■ vertical  correlation  factor. 

For  the  second  order  Markov  model,  two  additional  parameters 
are  needed. 

3h  ■ horizontal  spatial  frequency 
8y  * vertical  spatial  frequency 

b.  Real  World  Infrared  Image 

Twenty  successive  frames  of  a real  world  infrared 
image  in  the  medium  wavelength  infrared  spectral  band  are 
used  in  the  test  of  sequential  spatial- temporal  filters. 

The  target  intensity  and  the  unprocessed 
image  are  combined  together  and  described  by  another  very 
important  parameter. 

Input  signal  to  noise  ratio  * SNRI 

3 . Properties  and  Performances  Evaluated 

The  following  properties  and  performance  figures  of 
merit  are  evaluated. 
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a.  For  Clutter  Suppression: 

(1)  Filter  coefficients  as  functions  of  input 
signal  to  noise  ratio  and  correlation  factors. 

(2)  Processing  gain  as  functions  of  input  signal 
to  noise  ratio  and  correlation  factors. 

(3)  Spatial  side-lobes  after  the  application  of 
spatial  filters  as  functions  of  input  signal  to  noise  ratio. 

b.  For  Threshold  Detection: 

(1)  Threshold  levels  as  functions  of  input  signal 
to  noise  ratio,  using  the  probability  of  false  alarm  (PpA) 

as  a parameter. 

(2)  Probability  of  detection  as  functions  of 
input  signal  to  noise  ratio  and  probability  of  false  alarm. 

4 . Sensitivity  Analysis 

All  nonrecursive  filters  developed  in  this  thesis 
use  a common  set  of  mathematical  operations  which  is  the 
summation  of  weighted  and  delayed  signals.  The  differences 
among  four  nonadaptive  filters  developed  in  Chapters  III  and 
IV  and  adaptive  filters  to  be  developed  in  Chapters  VII  and 
VIII  are  in  the  criteria  and  design  procedures  of  their 
filter  coefficients.  Therefore,  there  exists  a real  interest 
in  using  new  sample  analog  tapped  delay  line  devices  which 
can  efficiently  carry  out  the  nonrecursive  filter  operations 
at  high  speed  because  it  is  a pipelined  and  parallel  processor. 
However,  the  disadvantage  of  sampled  analog  tapped  delay  line 
implementation  is  its  lower  accuracy.  Therefore,  a special 


115 


L 


| 


investigation  is  carried  out  by  truncating  and  rounding-off 
the  filter  coefficients  to  simulate  the  lower  accuracy  of 
sampled  analog  implementation  and  investigating  their 
effects  on  filter  performance. 

S.  Suboptimal  Filter  Investigation 

In  practical  applications  the  noise  parameters  that 
were  used  to  design  the  filter  coefficients  might  be  in- 
accurate, resulting  in  a "suboptimal"  filter.  The  suboptimal 
filter  performance  is  investigated  in  this  thesis  by  monitor- 
ing the  PG  of  a given  "suboptimal"  filter  while  the  background 
noise  correlation  factor  (pH  ■ pv)  is  changed  from  0 to  1. 

C.  SINGLE  FRAME  PROCESSING  I - NONRECURSIVE  SPATIAL 

MMSE  FILTER  FOLLOWED  BY  THRESHOLDING 

1.  Introduction 

An  isotropic  second  order  Markov  process  model  is 
used  to  simulate  the  correlated  spatial  noise  in  this  section. 
The  spatial  frequencies  of  the  correlated  noise  are 
SH  * 6V  * £ * 0.267.  The  horizontal  and  vertical  correlation 
factors  are  varied.  The  variance  of  the  correlated  noise  is 
1.0.  The  variance  of  the  uncorrelated  noise  is  0.01.  The 
target  intensity  is  also  varied  and  is  described,  together 
with  the  spatial  noise,  by  the  parameter  "input  signal  to 
noise  ratio"  C.SNRI). 

2 . Filter  Coefficients 

Since  the  unprocessed  images  contain  only  isotropic 
random  noises  and  point  targets,  the  filter  coefficients  are 
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centrally  symmetrical.  Of  the  nine  filter  coefficients, 
there  are  only  three  distinct  values:  center  coefficient  W$, 
corner  coefficient  * W7  • Wg,  and  edge  coefficient 

Wj  • ■ Wg  • Wg.  They  are  presented  in  Fig.  6-1 (a)  and  (b) 

as  functions  of  input  signal  to  noise  ratio  and  for  five 
different  correlation  factors,  ph  « pv  ■ p * 0.999,  0.99, 

0.9,  0.8  and  0.4.  It  should  be  pointed  out  that  p ■ 0 cor- 
responds to  the  uncorrelated  random  noise  case  and  p ■ 1 
corresponds  to  the  deterministic  case. 

The  following  observations  of  their  behaviors  are 

made. 

a.  Symmetry 

Filter  coefficients  have  a central  symmetry  as 
described  above. 

b.  Coefficient  Values 

All  coefficient  values  are  less  than  unity.  They 
are  easy  to  implement  in  hardware  if  sampled  analog  image 
processing  is  used  by  simply  using  a resistor  potentiometer. 

The  sum  of  nine  coefficients  is  very  close  to 
zero.  This  implies  that  this  type  of  spatial  filter  will 
usually  suppress  the  spatial  mean  of  background  noise.  It 
can  be  considered  as  a "whitening"  spatial  filter. 

c.  Dependence  on  Correlation 

As  the  correlation  factor  approaches  unity,  the 
filter  coefficients  change  less  and  less  as  p varies  and  are 
also  independent  of  input  signal  to  noise  ratio.  In  the  limit 
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Filter  coefficients  configuration 


♦ 

of  p ■ 1,  the  filter  coefficients  approach  the  values  of  a 
spatial  Laplacian  mask  in  those  cases  when  and  are 
small  (_<  0. 26) . 

The  Laplacian  0.25  -0.5  0.25 

mask  fcr  point 

target:  -0.5  1 -0.5 

0.25  -0.5  0.25 

For  high  values  of  spatial  frequencies,  SH  and  3y  (>0.26), 
the  filter  coefficients  are  different  than  the  Laplacian  mask. 

In  the  other  direction,  when  p approaches  zero 
all  eight  filter  coefficients  other  than  the  middle  coeffi- 
cient are  decreased.  In  the  limit  of  p ■ 0,  only  the  middle 
coefficient  is  non  zero.  This  indicates  that  in  the  extreme 
case  of  uncorrelated  spatial  noise,  there  is  no  help  provided 
by  using  neighboring  signals  to  estimate  a point  target  and 
to  suppress  the  background  noise  because  the  noise  is  not 
correlated. 

d.  Dependence  on  Input  Signal  to  Noise  Ratio 

Filter  coefficient  values  become  smaller  as  the 
input  SNR  is  decreased.  It  can  be  understood  because  the  MMSE 
filter  is  designed  to  give  the  optimal  estimate  of  the  target 
signal.  When  the  noise  is  high,  the  filter  tends  to  attenuate 
the  noise  by  smaller  coefficient  values  and  to  yield  the 
estimation  of  the  small  target  value. 
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3.  Processing  Gain 

Processing  gain  of  the  spatial  MMSE  filter  is  pre- 
sented in  Fig.  6- 2 (a)  as  functions  of  input  signal  to  noise 
ratio  for  different  correlation  factors  and  in  Fig.  6- 2(b) 
as  functions  of  correlation  factors.  The  following  obser- 
vations are  made. 

a.  Dependence  on  Input  Signal  to  Noise  Ratio 

The  processing  gain  of  spatial  MMSE  filter  for 
point  target  estimation  is  independent  of  input  SNR. 

b.  Dependence  on  Correlation 

The  processing  gain  is  strongly  dependent  on  the 
correlation  factor.  The  higher  the  correlation,  the  larger 
processing  gain  can  be  achieved,  but  this  will  be  affected 
by  the  intensity  of  uncorrelated  noise  components  also  in  the 
image.  For  example,  in  this  particular  case,  the  PG  of  approx- 
imately 45  db  is  achieved  for  p = 0.999,  as  shown  in  Fig.  6-2(a). 
If  the  uncorrelated  spatial  noise  is  excluded,  which  is  the 
case  in  Fig.  6- 2(b)  when  p = 1,  the  PG  can  be  as  high  as  60  db . 
Unfortunately,  uncorrelated  noise  always  exists  in  real  world 
images  due  to  background  shot  noise,  electronic  noise,  etc. 

As  approaches  zero,  the  PG  decreases.  In  the 
limit  p = 0,  PG  * 1 which  confirms  the  discussion  in  the  last 
section  on  filter  coefficients. 

4 . Threshold  Level  and  Spatial  Side  Lobe  Level 

Threshold  level  and  spatial  side  lobe  level  are 

related  because  if  the  threshold  is  set  below  the  side  lobe 


121 


f 


[ 


— —— 


- — 1 , 


level,  a false  alarm  will  result.  The  spatial  side  lobe 
level  is  determined  by  multiplying  the  highest  positive 
filter  coefficient  with  the  target  level. 

In  Fig.  6-3Ca),  (b),  threshold  levels  are  plotted  as 
functions  of  input  SNR  for  several  values  of  probability  of 
false  alarms  from  10'1  to  10 and  a given  correlation  factor. 
Curves  are  presented  for  p = 0.99,  p “ 0.9,  p * 0.8,  and 
P » 0.4.  Two  observations  are  made: 

a.  Dependence  on  Correlation 

As  P is  increased,  the  threshold  value  can  be 
lowered  to  achieve  the  same  PpA-  This  is  because  the  pro- 
cessing gain  of  the  spatial  MMSE  filter  is  better  for  higher 
P. 

b.  Dependence  on  PpA 

As  Pp^  is  reduced,  threshold  value  must  be  in- 
creased. 

The  spatial  side  lobe  levels  are  presented  in 

Fig.  6-3(a),(b)  as  well  as  functions  of  input  signal  to  noise 

ratio.  By  comparing  the  threshold  level  plots  and  side  lobe 

level  plots  corresponding  to  the  case  of  p * 0.9  in  Fig. 

6-3(a),  it  can  be  seen  that  false  alarms  due  to  side  lobes 

will  occur  for  input  SNR  approximately  above  -4  db  for 

- 2 - 1 

threshold  levels  in  the  range  10  < PpA  < 10 

S . Probability  of  Detection 

A set  of  figures  (Fig-  6-4)  is  used  to  present  the 
probability  of  detection,  P^,  as  functions  of  input  SNR  for 
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several  values  of  PpA  from  10  * to  10  Each  figure  is  for 
a selected  correlation  factor,  ph  » Py. 

It  should  be  emphasized  that  the  two  figures  of  merit 
of  PG  and  P^  must  be  used  together  in  the  evaluation  of 
effectiveness  of  focal  plane  processing.  Otherwise,  mislead- 
ing evaluation  could  result  as  demonstrated  by  the  following 
example. 

Consider  a case  of  p * 0.9;  the  processing  gain  of 
a 3x3  spatial  MMSE  filter  for  point  target  estimation  is  20 
db.  It  could  be  interpreted  that  any  target  of  input  SNR 
better  than  -20  db,  say  -12  db,  can  be  detected.  However, 
the  Pd  plot  in  Fig.  6-4  reveals  that  for  PpA  ■ 10'^,  the 
probability  of  detection  of  a weak  target  of  -12  db  is  very 
low.  Pd  is  less  than  0.9  even  for  a stronger  target  of  -7  db. 
Therefore,  the  capability  of  a focal  plane  processing  process 
consisting  of  a spatial  filter  for  clutter  suppression  (eval- 
uated by  PG)  and  thresholding  (evaluated  by  P^)  must  be  cor- 
rectly determined  by  using  both  PG  and  P . 

6 . Summary 

Some  highlights  of  the  first  type  of  focal  plane  pro- 
cessing which  consists  of  spatial  MMSE  filtering  and  thresh- 
olding are; 

a.  The  processing  gain  is  strongly  affected  by 
correlation  factor,  relative  intensity  of  white  noise,  types 
of  targets,  search  box  size  and  location  of  estimation  pixel 
[Ref.  14]. 
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b.  Input  SNR  does  not  affect  the  processing  gain 


V 


but  will  influence  the  probability  of  detection. 

D.  SINGLE  FRAME  PROCESSING  II  - NONRECURSIVE  SPATIAL 

MATCHED  FILTER  FOLLOWED  BY  THRESHOLDING 

1.  Introduction 

The  same  unprocessed  image  used  in  the  study  of 
nonrecursive  spatial  MMSE  filters  is  used  in  this  section. 

There  will  be  a great  deal  of  similarities  in  the  organiza- 
tion of  presenting  the  results  also. 

2 . Filter  Coefficients 

Figure  6- S (a) , (b) , (c)  presents  the  filter  coefficients 
as  a function  of  input  SNR  for  several  isotropic  correlation 
factors.  Since  point  targets  are  being  considered  and  only 
isotropic  noises  exist  in  the  unprocessed  image,  the  filter 
coefficients  have  again  a central  symmetry.  Only  three  of 
the  nine  filter  coefficients  need  to  be  presented  - W(l), 

W(2)  and  W(S). 

It  can  be  seen  that  their  values  are  not  only  very 
large  but  also  have  strong  dependence  on  the  input  SNR.  Both 
facts  are  inconvenient  in  hardware  implementation.  (It  should 
be  remembered  that  in  spatial  MMSE  filters,  the  filter  coeffi- 
cients are  all  less  than  one  and  are  independent  of  input  SNR.) 
These  difficulties  with  the  matched  filter  can  be  removed  by 
a proper  choice  of  the  constant  C in  the  solution  of  the 
coefficient  equation  (3-4.28)  to  normalize  the  filter  coeffi- 
cient for  the  estimation  pixel  to  unity.  Figure  6-6(a),(b) 
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Hatched  Filter  W(l)=W(3)*W(u)=H(9) 

Coefficients  +6 

(Unnoraalized) 
as  a function  of 


Unnoraal 


Matched  Filter  Coefficients  as  a Function  of  Input  SNR;  P„  * ft.  * Parameter 


shows  the  dependence  of  filter  coefficients  after  the  normal- 
ization. 

Other  observations  made  for  the  MMSE  filters  also 
apply  for  the  matched  filters. 

3.  Processing  Gain 

The  processing  gain  of  the  spatial  matched  filter  for 
point  target  estimation  is  presented  in  Fig.  6-7  as  a function 
of  input  signal  to  noise  ratio  for  different  isotropic  corre- 
lation factors,  pH  ■ py 

Again,  the  general  observations  obtained  for  the  MMSE 
filters  are  also  valid  in  the  matched  filter  cases.  In  fact, 
by  comparing  Fig.  6-7  with  Fig.  6-2(a),  it  is  discovered  that 
although  the  filter  coefficients  for  these  two  filters  are 
quite  different,  their  processing  gains  are  the  same.  This 
result  can  be  justified  by  using  the  following  reasoning.  The 
MMSE  filter  is  designed  to  suppress  the  noise  and  to  yield  the 
best  estimate  of  the  signal.  The  matched  filter  is  designed 
not  only  to  suppress  the  noise  but  also  to  enhance  the  signal. 
This  second  feature  of  the  matched  filter  results  usually  in 
signal  distortion  in  contrast  to  the  MMSE  filter  which  is 
designed  to  yield  the  best  estimate  of  the  signal.  When  the 
concerned  signal  is  a point  target,  as  in  the  above  case,  the 
normalized  matched  filter  cannot  affect  the  signal  and  there- 
fore both  matched  filter  and  MMSE  filter  will  only  suppress 
the  noise  to  the  same  extent,  resulting  in  the  same  PG. 
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SNRI  (db) 


Figure  6- 


7 Processing  Gain  of  Nonrecuvsive 

Spatial  Matched  Filter  as  a Function 
of  Input  Signal  to  Noise  Ratio  and 
Correlation  Factor. 
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4 . Threshold  Level  and  Side-Lobe  Level 

Threshold  levels  are  plotted  in  Fig.  6-7(a),(b)  as 
functions  of  input  SNR  for  several  values  of  PpA  from  10’ 1 
to  10*5  and  a selected  correlation  factor.  Several  figures 
are  presented  for  different  p's. 

Side  lobe  levels  are  also  shown  in  Fig.  6-7(a),(b) 
as  functions  of  input  SNR. 

Again,  there  are  many  similarities  between  the  spatial 
matched  filters  and  the  spatial  MMSE  filters  presented  in  the 
last  section.  It  should  be  noted  that  the  threshold  level  of 
the  normalized  matched  filter  does  not  vary  with  SNRI  as  it 
does  for  the  MMSE  filter. 

5 . Probability  of  Detection 

The  probability  of  detection  is  presented  in  Fig.  6-3 
as  functions  of  input  SNR  for  several  values  of  PFA  from  10* * 
to  10 " ^ . Each  figure  is  for  a selected  correlation  factor. 

6 . Summary  and  Comparison  with  MMSE  Filters 

Comparing  spatial  matched  filter  results  of  this  sec- 
tion and  spatial  MMSE  filter  results  in  the  previous  section, 
many  similarities  are  observed.  The  only  difference  is  in 
the  filter  coefficients.  It  must  be  pointed  out  that  these 
observations  are  true  only  for  point  targets.  For  other 
targets,  MMSE  filters  and  matched  filters  will  not  be  as 
similar  as  in  the  case  of  point  targets.  It  is  believed  that 
for  extended  targets,  the  matched  filters  will  offer  more 
superior  processing  gain  and  probability  of  detection  because 
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Probability  of  Detection  as  a Function  of  Input  SNR;  PFA  * Parameter 


the  matched  filter  is  designed  to  enhance  the  target  as  well 
as  suppressing  the  noise,  as  mentioned  in  VI. 0.3. 
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E.  SUBOPTIMAL  SPATIAL  FILTERS 

1.  Filter  Coefficients  Accuracy 

When  filter  coefficients  are  inaccurate  due  to  round- 
off error  or  other  implementation  constraints,  the  processing 
gain  will  deteriorate  accordingly.  Fig.  6-9  presents  the 
deterioration  in  PG  as  a result  of  artificial  coefficients 
round-off  at  a certain  location  after  the  decimal  point.  It 
is  seen  that  round-off  at  the  fourth  place  after  the  decimal 
point  hardly  affects  the  PG. 

2 . Suboptimal  Filter  Performances 

When  the  correlation  factor  of  the  noise  is  expected 
to  vary  within  the  image,  it  is  necessary  to  determine  which 
is  the  best  "suboptimal"  filter.  Figure  6-10  shows  the 
resulting  PG  when  a filter  designed  for  a correlation  factor 
of  p-  0.999  is  facing  a correlation  factor  that  varies  from 
0 to  1.  Comparison  of  Fig.  6-10(a.l)  with  Fig.  6-9(a.l) 
reveals  that  the  resulting  deterioration  in  PG  in  various  p's 
is  from  G to  about  3 db.  Figures  6- 10 (a. 2) , (a . 3) , (a . 4)  and 
(a. 5)  are  similar  to  Fig.  6-10(a,l)  with  filters  designed  for 
p*0.99,  0.9,  0.8  and  0.4  respectively. 

The  strongest  deterioration  in  PG  is  noticed  in  the 
suboptimal  filter  related  to  p-0.4  (Fig.  6-10(a.5))  and  the 
least  deterioration  is  noticed  in  the  filter  related  to 
P ■ 0.999  (Fig.  6-10(a. 1) ) . 
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i-w  p 0.0  .25 

(a)  Processing  Gain  [db]  as  a function  of  p - of  suboptiaal  filters 


Fig.  6-10(b)  Processing  gam  [dbj  as  a function  of  p suboptimal  filter 


Conclusion:  The  best  suboptiraal  filter  in  this  case 
was  found  to  be  the  one  designed  for  p«  0.999.  Similar  sub- 
optimal  studies  should  be  performed  to  select  the  best  "sub- 
optimal"  filter  whenever  noise  statistics  are  expected  to 
vary  and  when  filter  coefficients  cannot  be  adapted  on  line. 

F.  MULTIPLE  FRAME  PROCESSING  - NONRECURSIVE  SEQUENTIAL 
SPATIAL- TEMPORAL  FILTER  FOLLOWED  BY  THRESHOLDING 

1.  Introduction 

To  evaluate  three  dimensional  spatial- temporal  focal 
plane  processing,  successive  frames  of  images  are  needed. 

In  Chapter  IV,  theoretical  models  based  on  Markov  processes 
were  used  for  correlated  noises.  In  the  spatial  domain, 

both  first  order  and  second  order  Markov  model  correlated 

f ) 

spatial  noises  are  considered.  Only  first  order  Markov  model 
was  considered  for  the  temporal  correlated  noise. 

In  this  section,  instead  of  using  those  computer 
generated  images  containing  Markov  model  correlated  noise, 
one  set  of  real  world  infrared  images  of  32x32  pixels  with 
constant  drift  of  10%  of  a pixel  between  frames  is  used  to 
evaluate  the  performance  of  the  sequential  spatial- temporal 
filter  followed  by  a thresholding.  Except  that  it  was  orig- 
inally taken  by  an  ERIM^  background  measurement  and  subse- 
quently modified  by  another  group  to  include  drift  and  several 
other  modifications,  no  detailed  information  was  given  because 

^ERIM  is  the  Environmental  Research  Institute  of  Michigan 


of  the  classified  nature  of  the  program  which  developed  this 
scene  as  a standard  test  for  focal  plane  processing  algorithms. 
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In  this  section,  statistical  spatial  filters  are 
first  designed  for  each  frame  to  suppress  clutter.  The  sta- 
tistical  spatial  correlation  properties  of  every  frame  of 
images  are  calculated  separately  and  used  in  the  filter 
design.  Then,  several  frames  of  these  spatially- filtered 
images  are  used  together  for  the  calculation  of  their  temporal 
correlation  properties  which  are  used  to  design  a temporal 
filter  which  will  be  applied  to  several  frames  of  spatial- 
filtered  images  to  give  one  frame  of  spatial-temporal  filtered 
image.  A threshold  level  is  then  determined  from  the  PDF  of 
the  intensity  of  the  filtered  image  and  applied  to  initiate 
the  target  detection.  These  procedures  were  developed  in 
another  thesis  by  Captain  D.  Hilmers  [30] . 

2 . Spatial  Filters  and  Their  Performance 

Figure  6-11  is  a nine  gray-level*  computer  overlay 
print  of  one  frame  of  the  real  world  infrared  image.  Figure 
6-12  is  a plot  of  its  probability  density  function.  The  mean 
is  found  to  be  4.03  and  the  variance  is  .45.  Six  moving 
targets  of  intensity  0.001,  shown  in  Fig.  6-13,  are  added  to 
this  frame  of  image.  This  corresponds  to  an  input  signal  to 
noise  ratio  of  -72.3  db.  The  targets  move  down  1 pixel  for 
each  frame. 

*N ine  gray  level : "blank"  -,+ , V,  M,  0,  0,  0,  8,  ■ 
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Figure  6-11  9 Gray-level  Computer  Print  of  One 

Frame  of  32  by  32  Pixels  "Mill  Creek" 
Infrared  Image. 
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Histogram  of  the  Intensity 
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At  this  low  input  SNR  and  for  point  targets  there 
is  no  difference  between  the  MMSE  filter  and  the  matched 
filter.  A 3x3  spatial  filter  is  designed  and  its  filter 
coefficients  are  shown  in  Fig.  6-14.  This  spatial  filter 
is  then  applied  throughout  this  32  x 32  image.  The  spatial- 
fiitered  image  is  shown  in  Fig.  6-14  with  its  new  PDF  shown 
in  Fig.  6-15.  It  can  be  seen  that  the  new  PDF  is  somewhat 
symmetrical  around  zero  intensity,  indicating  a zero  mean. 

3.  Temporal  Filter  and  Its  Performance 

Five  consecutive  spatial  filter  frames  of  images  are 
filtered  by  a temporal  matched  filter  whose  coefficients  are 
shown  in  Fig.  6-16.  The  resulting  temporal  filtered  image 
is  shown  in.  Fig.  6-16  with  its  PDF  shown  in  Fig.  6-17.  The 
processing  gains  of  both  the  spatial  and  temporal  filters  are 
also  listed  in  Figs.  6-14  and  6-16  respectively.  A threshold 
is  then  set  to  yield  a PfA  of  10*3  and  the  resulting  image  is 
shown  in  Fig.  6-18.  It  should  be  recognized  that  the  third 
frame  is  the  "estimation  frame"  of  this  five  frame  temporal 
filter.  Consequently,  the  targets  in  Fig.  6-18  appear  3 pixels 
down  relative  to  their  location  in  Fig.  6-13. 

4 . Conclus ions 

The  spatial- temporal  filtering  method  is  a very  useful 
technique  for  suppression  of  correlated  clutter  and  detection 
of  low  signal  level  target.  In  the  general  case  when  K two 
dimensional  frames  of  images  are  given,  an  optimal  spatial- 
temporal  filter  can  be  designed  for  a given  shaped  target  to 
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Figure  6-14  Mine  Gray- level  Computer  Print  of 
Spatially  Filtered  First  Frame  of 
"Mill  Creek"  Image 
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Figure  6-lt> 


Nine  Gray-level  Computer  Print  of 
Spatially  and  Temporally  Filtered 
Third  Frame  "Mill  Creek"  Image  Including 
Background  Clutter  and  Point  Targets. 
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18  Nine  Gray-level  Computer  Print  of  the 
Third  Frame  of  "Mill  Creek"  Image  after 
Spatial-Temporal  Filtering  and  Thresholding. 
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achieve  a certain  processing  goal.  These  goals  and  the 
resulting  filter  design  method  have  to  be  evaluated  for  the 
particular  application.  In  this  chapter,  a spatial  temporal 
filter  for  the  enhancement  of  moving  point  targets  has  been 
designed  and  tested  using  real  IR  clutter  images.  The 
results  indicated  that  this  type  of  filter  can  yield  a 
processing  gain  as  high  as  60-70  db. 
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VII.  ADAPTIVE  SPATIAL  FILTER  I - 

STATIONARY  CLUTTER  STATISTICS 
— 

A.  INTRODUCTION 

In  previous  chapters,  two  types  of  filters  were  discussed: 
the  two  dimensional  and  three  dimensional  MMSE  filters  and 
matched  filters,  along  with  their  design  and  implementation 
schemes.  The  performance  of  these  filters  was  analyzed  and 
presented.  They  both  offer  significant  suppression  of  clutter 
noise  when  properly  designed.  The  first  problem  we  face  when 
trying  to  design  the  filter  is  the  unknown  statistical  proper- 
ties of  the  noise.  The  second  and  more  serious  problem  is 
the  nonuniformities  of  the  statistical  properties  of  the  noise. 
In  other  words,  the  noise  is  nonstationary. 

In  this  chapter,  a two  dimensional  adaptive  filtering 
technique  will  be  developed  for  cases  where  statistical 
properties  of  the  noise  are  unknown  but  does  not  vary  (sta- 
tionary statistics).  Extension  to  the  nonstationary  statis- 
tical properties  of  the  image  will  be  presented  in  Chapter 
VIII.  An  adaptive  algorithm  will  be  developed  first  for  the 
Wiener  filter,  followed  by  a suggested  modification  to  the 
matched  filter. 

B.  ADAPTIVE  WIENER  FILTER 

The  requirement  for  this  adaptive  algorithm  is  to  change 
the  filter  coefficients  to  minimize  the  mean  square  error  as 
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fast  as  possible  based  on  the  clutter  noise  characteristic. 
The  adaptation  is  achieved  by  utilizing  the  steepest  descent 
algorithm  together  with  a proper  selection  of  required  refer- 
ence performance.  Steepest  descent  is  a well  established 
technique  for  one  dimensional  adaptive  filters.  Extension 
of  this  technique  to  two  dimensional  adaptive  filters  will 
be  presented  in  the  following  sections.  An  implementation 
scheme  will  be  suggested  along  with  simulation  results  and 
performance  analysis. 

It  should  be  pointed  out  that  there  is  another  important 
difference  from  the  previously  developed  one  dimensional 
filters.  Most  one  dimensional  adaptive  filters  are  designed 
to  operate  in  a white  noise  environment  with  correlated 
target  Samples.  In  this  study,  instead  of  white  noise,  we 
are  facing  a highly  correlated  noise.  On  the  other  hand, 
targets  are  often  uncorrelated.  For  example,  point  targets 
are  un.orrelated  in  both  x and  y variables.  Horizontal  line 
targets  are  uncorrelated  in  the  vertical  direction. 

There  are  two  approaches  to  suppress  the  correlated 
noise . 

1.  The  first  approach  is  to  treat  the  correlated  noise 
as  if  it  were  a "signal'*  and  try  to  predict  (or  estimate)  its 
value  in  each  pixel.  Reference  34  demonstrates  this  basic 
concept  utilizing  an  adaptive  filtering  technique.  Refer- 
ences 13  and  35  demonstrated  again  this  concept  by  utilizing 
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a two  dimensional  Kalman  filter  rather  than  an  adaptive 
filter. 

2.  The  second  approach  is  to  treat  the  correlated  noise 
as  "noise,"  and  to  design  an  optimal  noise  suppression  tech- 
nique based  on  the  statistical  noise  and  target  character- 
istics . 

In  this  work,  the  second  approach  is  taken  by  direct 
adaptation  of  the  filter  coefficients  so  as  to  minimize  the 
mean  square  error  between  the  target  and  the  target  estimate. 

] 

This  approach  was  selected  since  it  seemed  to  be  easier  for 
practical  implementation. 

C.  ADAPTIVE  ALGORITHM  BASED  ON  STEEPEST  DESCENT 
( Steepest  descent  is  an  effective  adaptation  technique 

and  was  shown  to  be  superior  [21]  to  other  adaptive  methods 
when  a reference  input  can  be  specified. 

The  analysis  of  this  method  is  similar  to  the  analysis 
of  nonrecursive  spatial  filters  presented  in  Chapter  III. 

The  input  signal  vector,  Xj , is  defined  as 

X-  * [x.  • • **i  • • **r  ] (7-1) 

J Xj 

The  filter  coefficients  are 
T 

W ■ [w.  ,w,  ,..w.  . . . w.  ] (7-2) 

2j  j 

The  input  signals  are  assumed  to  appear  simultaneously 
on  all  input  lines  at  discrete  spatial  locations  indexed  by 
the  subscript  j ; j is  the  pixel  number  in  the  image  as  was 
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shown  before  in  Fig.  4-2  where  j ■ NMAX  (n-1)  ♦m;  i is  the 
index  describing  the  location  of  the  input  samples  in  the 
search  box  as  in  Fig.  4-2  where  i - MSB  * ( n - 1)  ♦ m. 

The  input  signals  are  multiplied  by  the  nonrecursive 
filter  coefficients  w^w^.-Wj  and  then  summed  together  as 
shown  in  Fig.  7-1. 


Input 

signals 


X2  I x3  I — XI| 


Filter 

coefficients 


Figure  7-1 

The  general  filtering  configuration  is  given  in  Fig.  7-2. 

In  the  following,  an  adaptive  method  will  be  presented  to 
adapt  the  filter  coefficients  W^...Wn  to  achieve  an  optimal 
estimate  of  a known  signal.  It  will  be  shown  that  at  steady 
state  the  filter  coefficient  will  approach  the  Wiener  filter 
coefficients.  A review  of  the  adaptive  filtering  formulation 
based  on  references  21,  22  will  be  presented  in  Appendix  C. 

The  algorithm  derivation  is  based  on  the  following  model. 
At  a given  pixel,  the  output  of  the  filter  is 


" XjT  W " w?xj 


(7*3) 
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Figure  7-2  Configuration  of  Nonadaptive  Two 
Dimensional  Nonrecursive  Spatial 
Filter. 
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Let  us  select  a desirable  reference  performance,  dj  , 
which  we  seek  to  achieve  at  the  steady  state.  For  example, 
in  the  case  of  point  target  detection  Cor  estimation),  we 
seek  to  achieve  the  best  estimate  of  a point  target  while 
suppressing  the  background  clutter  noise  as  much  as  possible. 
Similarly,  in  case  of  line  target  detection  (or  estimation), 
we  seek  to  achieve  the  best  estimate  of  a given  line  while 
suppressing  the  clutter  noise. 

Let  us  define  the  error  at  pixel  location  j to  be 


e . « d . - y . 
3 J 


di  • »T*j 


(7-4) 


It  is  the  purpose  of  the  adaptive  process  to  adjust 
the  weighting  coefficients  of  the  linear  adaptive  filter 
to  minimize  the  mean  square  error  e ^ . 

In  this  chapter  we  will  make  the  assumption  that  the 
clutter  noise  is  stationary.  In  the  following  chapter,  a 
method  will  be  suggested  to  deal  with  nonstationary  clutters, 
where  the  statistical  properties  can  be  assumed  to  be 
stationary  only  within  a small  area.  The  detailed  adaptation 
method  and  derivation  are  explained  in  Appendix  C. 


D.  TWO  DIMENSIONAL  ADAPTIVE  FILTERING  CONSIDERATIONS 
1.  Introduction 

In  this  section,  "non -optimal"  spatial  filtering 
will  be  described  to  introduce  the  need  for  adaptive  filter- 
ing. For  this  purpose,  a composite  simulated  image  is  used 
which  consists  of  four  subimages  simulated  by  computer  and 
having  four  different  statistical  correlated  noise  charac- 
teristics as  shown  in  Fig.  7-3. 

Upper  left  quadrant:-  2nd  order  Markov  model 

8^  * 0.628 
8y  * 0.063 
0H  - pv  - 0.95 

Upper  right  quadrant:-  2nd  order  Markov  model 

SH  « 0.063 
8V  - 0.628 
PH  » PV  - 0.95 

Lower  left  quadrant:-  2nd  order  Markov  model 

8^  ■ 0.628 
8y  - 0.628 
PH  - py  * 0.95 


Lower  right  quadrant :- 


1st  order  Markov  process 


ens 


Based  on  the  statistical  properties  of  each  quadrant,  optimal 
spatial  MMSE  filter  can  be  designed  as  follows: 

For  upper  left  quadrant: 

.3  -.5  .3 

-.6  1.0  -.6 

.3  -.5  .3 

For  upper  right  quadrant: 

.3  -.6  .3 

-.5  1.0  -.5 

.3  - .6  .3 

For  lower  left  quadrant; 

.36  -.6  .36 

-.6  1.0  -.6 

.36  ™ . 6 .36 

For  lower  right  quadrant: 

.24  -.487  .24 

.499  1.0  .499 

.243  -.487  .243 

However,  Fig.  7-4  shows  the  filtered  image  by  using  only  one 
spatial  MMSE  filter  optimally  designed  for  the  upper  right 
quadrant  but  applied  throughout  the  whole  image.  It  should 
be  pointed  out  that  a threshold  was  applied  after  the  spatial 
filtering  to  obtain  Fig.  7-4,  It  can  be  seen  that  excellent 

"clutter  noise"  suppression  was  accomplished  in  the  optimal 
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Filtered  and  Thresholded  Image 
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Probability  of  false  alarm  is  0.1462. 

[V  £ false  alarm] 

Figure  7-4  Computer  Print  of  Nonadaptively  Filtered  and  Thresholded 
Four  Quadrant  "Nonstationary"  Clutter  Image. 
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filter  quadrant.  Considerable  amount  of  clutter  noise 
remained  in  the  other  three  "suboptimal"  filtered  quadrants. 

It  would  be  desirable  if  an  adaptive  algorithm  can  be  devel- 
oped so  that  the  filter  coefficients  will  be  adaptively 
changed  to  new  optimal  values  when  the  filter  is  moved  into 
areas  having  different  statistics. 

An  example  of  such  an  adaptive  filter  configuration 
is  shown  in  Fig.  7-5.  Similar  to  all  other  spatial  filters 
developed  in  this  thesis,  it  uses  a 3x3  search  box.  Signals 
of  all  nine  pixels  in  the  box  are  weighted  and  summed  to 
give  an  estimate  of  the  target  signal  at  the  central  pixel. 
However,  there  are  two  major  differences.  First,  the  weight- 
ing coefficients  are  adaptively  changed  by  a feedback  proced- 
ure as  shown  in  Fig.  7-5.  At  the  beginning,  nonrecursive 
spatial  filtering  is  carried  out  as  described  previously. 

The  processed  target  signal,  y.t  is  now  compared  with  the 
selected  desirable  reference  target,  , by  subtraction  and 
produces  an  error  signal,  e ■ . This  is  then  multiplied  by  the 
adaptive  loop  gain  constant,  y,  and  then  by  the  nine  corres- 
ponding unprocessed  signals,  X,  to  process  a correction 
weighting  coefficient,  AW^ , for  its  corresponding  coefficient, 
Wj . The  new  filter  coefficients,  Wj  + AWj , are  used  to  perform 
a new  step  of  spatial  filtering  and  generate  an  additional 
set  of  corrections  to  the  filter  coefficient.  Then  the  esti- 
mation pixel  is  moved  one  pixel,  a new  set  of  unprocessed 
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Figure  7-S  Configuration  of  Adaptive  Two  Dimensional 
Nonrecursive  Spatial  Filter. 
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signals,  X,  is  read  out  and  the  adaptive  filter  process  is 
repeated  again.  This  adaptive  process  is  repeatedly  carried 
out  according  to  the  process  described  in  Appendix  C and 
based  on  the  LMS  adaptive  algorithm,  equation  (042),  until 
the  steady  state  optimal  solution  is  reached.  The  second 
difference  of  this  adaptive  spatial  filter  from  the  non- 
adaptive  spatial  filter  is  in  the  scann_ng  pattern  of  the 
estimation  pixel.  It  is  not  the  conventional  raster  that 
the  estimation  pixel  is  moved  back  after  the  completion  of 
each  row  and  is  always  scanned  in  the  same  direction.  Instead, 
after  each  row,  the  scan  direction  is  reversed  as  shown  in 
Fig.  7-5.  The  reason  for  this  successive  reversal  of  scan 
direction  from  one  row  to  the  next  is  to  insure  that  the 
change  of  statistical  characteristics  of  the  clutter  noise 
is  minimized  because  in  this  new  scan  motion  the  estimation 
pixel  is  moved  only  by  one  pixel. 

More  details  on  the  implementation  of  adaptive  spatial 
filters  will  be  developed  in  the  next  section. 

2 . Detailed  Implementation  of  Adaptive  Spatial  Filter 

Several  aspects  of  adaptive  spatial  filter  implemen- 
tation are  described  in  more  detail  in  this  section: 

a.  Image  scanning  pattern 

b.  Termination  of  filter  coefficient  adaptation 

c.  Derivation  of  desired  reference  d^ 

d.  Selection  of  adaptive  loop  gain  y 
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e.  Required  number  of  independent  pixels  to  achieve 
adaptation 

a.  The  Image  Scanning  Pattern 

Several  image  scanning  patterns  were  tested. 
Figure  7-6  presents  two  possible  scanning  alternatives. 
Comparing  the  scanning  pattern  of  Fig.  7-6(a)  to  that  of 
7-6(b),  it  was  found  that  using  the  pattern  of  Fig.  7-6(b) 
to  adapt  the  filter  did  not  yield  the  optimal  filter  coeffi- 
cients. This  scanning  pattern  introduced  an  artificial 
transition  at  the  end  of  each  row  and  therefore  affected  the 
adaptive  process.  On  the  other  hand,  the  pattern  of  Fig. 
7-6(a)  offered  a smooth  adaptation  without  these  artificial 
transitions  and  the  resulting  adapted  filter  coefficients 
were  found  to  be  the  optimal. 

b.  Algorithm  for  Termination  of  Filter  Adaptation 
Several  algorithms  were  tested  for  termination 

of  filter  adaptation.  The  selected  algorithm  is  based  on 
the  following  steps  and  its  flow  chart  is  presented  in  Fig. 
7-7. 

Cl)  Test  the  MSE  at  each  n*  adaptation  step. 

(2)  Keep  track  of  the  lowest  MSE  * MSE  •„ CO) 

and  its  corresponding  filter  coefficients. 

C3)  Test  every  N*  (N>>n)  adaptation  step  whether 

the  new  MSE„.  * MSE  . „ Cl)  is  smaller  than  MSE„,.  CO)  by  a 
mxn  min'-  ' min'-  ' ' 


*n,N  are  constants  that  can  be  selected  either  by  simu- 
lation or  arbitrarily,  as  recommended  later  on. 


167 


F • 1 ♦ FI  I) /IOC 


Set  N,n,F,k  and 
MSE(O)  • MSE  initial 
MSEmin  * MSE  initial 


Perform  next  adaptation 
Step  K ■ k ♦ 1 


k • 1 
MSE(0)  - 

►^.in 

, -J 

Figure  7-7.  Software  Algorithm  to  Terminate  Filter  Adaptation 
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certain  factor  F ( say,  51).  If  smaller,  then  continue,  else 


terminate  adaptation.  Other  algorithms  based  on  monitoring 


the  filter  coefficients  error  or  continuous  tracking  of  MSE 


(short  term  observation)  did  not  yield  satisfactory  results. 


The  suggested  algorithm  was  tested  in  various  simulated  images 


and  it  functioned  well  whenever  the  parameters  F,  N,  n were 


selected  properly.  When  absolutely  no  a priori  knowledge  of 


noise  statistics  is  given,  these  parameters  can  be  selected 


for  the  worst  case:  for  example,  n * 36;  N * 360;  F * 0.1%. 


When  some  statistical  data  is  available,  these  parameters 


can  be  optimized  to  hield  fastest  indication  of  adaptation 


termination.  The  information  about  adaptation  termination 


is  necessary  mainly  for  the  following  two  purposes:  (1)  an 


attempt  to  filter  the  image  before  reaching  the  steady  state 


solution  will  yield  poor  noise  suppression;  (2)  in  Chapter 


VIII  a particular  application  of  the  adaptive  filtering 


technique  will  be  presented  by  dividing  the  image  into  many 


subimages  and  adapting  a different  filter  to  each  subimage. 


Under  such  circumstances  and  when  only  one  central  processor 


is  available,  it  is  important  to  detect  the  adaptation  ter- 
mination in  each  subimage  before  moving  to  the  next  sub  image. 


c.  The  Derivation  of  the  Designed  Response,  d. 


To  derive  the  desired  response,  dj , let  us  return 


to  the  LMS  adaptation  algorithm  presented  in  eq.  (C - 4 2 ) 


or 


Wj*l  ■ Wj  * ZMEj'Xj 

WjU  ' *j  ■ 2“VXj  ■ iWj  C7- 5) 


where  AVT  is  the  filter  coefficients  correction  vector  at 
adaption  step  j.  Substitution  of  the  error  equation  (C-2) 
into  ('7- 5)  will  yield. 


A*W 


2y(dj  - WT*  Xj ) • Xj  or 

AW . j 

<dj  - w ’V*; 


(7-6) 


Fig.  7-8  presents  typical  3x3  spatial  filter  and  the  corres- 
ponding input  samples  for  various  target  types. 

Referring  back  to  eq.  (7- 6) , let  us  expand  the 

>4 

matrix  for  the  simple  point  target  example  of  Fig.  7-8(a) 


A*W1  * xjt[*1W1  + • • U5  + S)W5  + ...  - s> 

A*ws  = (x5+s){[x1w1  + . . . (x5  + s)w5  + ...x9wg]  - s} 

! (7-7) 

A*Wg  = X9([X1W1  + ...  (xs  + s)w5  + ...XgWg]  - s} 


where  s is  used  twice  on  this  configuration  - once  as  the 
desired  response  dj , and  once  as  an  injected  signal  - injected 
artificially  to  sample  x^. 

As  mentioned  earlier,  the  adaptive  process  acts 
as  a low  pass  filter  smoothing  out  equation  (7-7  ) to  yield 
its  expected  value: 
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Figure  7-8  Operations  for  the  Generation  of  Reference  Input,  d 


E[A#1]  - E(XjX1]w1  + ..  Etx^jjwg  + ..  Efx^gjwg 

E [^5]  * E[XgX^]w^  + E[XgXg]Wg  + E[XjXg]Wg 

+ E[s-s]w5  - E[(xs  + s)*s] 

(7-8) 

E[AWg]  * E[XgX^]W^  * E[XgXg]Wj  + ..E[XgXg]Wg 

Assuming  the  signal  s and  the  noise  samples  X are  uncorre- 
lated. At  steady  state  E [^wV  ] i»l , 2 , . . . 9 will  be  zero  and 
eq.  (7-8)  can  be  rewritten  in  the  vector  form, 

(Rnn  ♦ Rss]  W - P (7-9) 

Assuming  the  input  samples  X consist  only  of  noise  and  the 
•target  is  summed  artificially  to  X. 

RNN  * cov  [noiseJ 
Rgs  * cov  [target] 

P * cross  correlation  vector  given  by  eq.  (C-5). 

Eq.  (7-  9)  is  indeed  the  Wiener  filter  equation  for  a point 
target.  We  can  proceed  in  a similar  way  to  construct  dj  for 
other  simple  type  targets. 

Let  us  summarize  the  steps  of  deriving  the  d^  in 
the  spatial  adaptive  filter  configuration: 

1.  The  target  shape  should  be  drawn  with  respect 
to  the  search  box  dimension. 

2.  All  the  X vector  locations  through  which  the 
target  will  pass  will  be  "marked’'  to  establish  a reference 
vector,  D ■ [d^d^.^dj].  All  the  "marked"  locations,  dm> 
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will  be  set  to  s i signal  desired  level,  and  the  remaining 
location  will  be  set  to  zero  according  to  the  shape  of  the 
target  of  interest. 

3.  While  adapting  the  filter  coefficients,  it 
is  assumed  that  relatively  few  pixels  contain  the  target. 

An  even  more  reasonable  assumption  can  be  made  for  practical 
imaging  systems,  considering  the  total  absence  of  the  external 
target  during  the  initial  adaptation  phase.  Making  this 
assumption  will  require  a preliminary  "learning"  period  prior 
to  utilizing  the  filter.  Under  this  assumption  the  referenced 
vector  D may  be  summed  together  with  the  input  sample  vector, 
X.  The  resulting  outcome  will  be  applied  to  the  filter  to 
yield  its  output,  y^ . 

4.  The  output,  y^ , will  be  subtracted  from  the 
referenced  signal  d . : s 5 signal  level  to  yield  the  error 
signal. 

5.  The  error  signal  multiplied  by  the  loop  gain, 
2u,  will  be  thus  multiplied  by  each  of  the  input  vector  (X+D) 
components  to  yield  the  correction  vector,  Aw. 

6.  At  steady  state  after  many  adaptation  steps, 
EUW]  will  approach  zero  and  the  Wiener  filter  solution  will 
be  reached. 

d.  The  Corresponding  "Adaptive"  Matched  Filter 

It  was  mentioned  earlier  in  this  work  that  the 
selected  major  goal  is  to  detect  point  targets.  It  is  inter- 
esting to  note  the  correspondence  between  the  adaptive  Wiener 
filter  for  point  target  enhancement  and  its  counterpart  - the 
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matched  filter.  Referring  back  to  eq.  (7-8),  let  us  select 
S to  be  extremely  small  compared  to  the  input  noise  samples. 
Under  this  condition,  eq.  (7-9)  will  become 

Rnn.W  - P (7-10) 

where  the  non- zero  term  of  RSgs(S2)  is  very  small  compared 
to  E[XgXj].  Recalling  from  matched  filter  derivation  that 
the  matched  filter  solution  is  given  by 

RNN*W  * OS  C?-11) 

where  C is  a constant  and  S is  the  signal  vector.  In  the 
case  of  point  targets,  both  P and  S will  be  in  the  same  form. 

P * [0, . . . s ,...0] 

S * [0 .... s , ...  0] 

Since  we  can  select  the  constant  C arbitrarily,  selecting 
C * S will  cause  eq.  (7-11)  to  be  identical  to  eq.  (7-10). 

A practical  implementation  method  to  adapt  the 
corresponding  matched  filter  was  performed  in  this  work  as 
the  following: 

1.  Select  dj  = S = 0 to  satisfy  equation  (7-10). 

2.  Since  the  constant  C may  be  selected  arbitrar- 
ily and  likewise,  one  of  the  filter  coefficients  can  be 
selected  arbitrarily,  the  estimation  point  coefficient  was 
selected  to  be  1.00.  Resulting  simulated  adaptation  plots 
will  be  presented  in  this  chapter.  This  modified  fc'iener 
filter  coefficients  adaptation  curve,  when  compared  to  the 
theoretical  matched  filter  coefficients,  shows  excellent  agree- 
ment. 
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To  conclude  the  matched  filter  discussion,  let 
us  note  that  for  the  case  of  point  target  enhancement  a 
modified  adaptive  Wiener  filter  will  yield  a corresponding 
matched  filter.  For  targets  other  than  point  targets,  in 
many  practical  cases  we  can  find  a corresponding  matched 
filter  counterpart.  This  issue  is  beyond  the  scope  of  this 
work  and  will  not  be  pursued  any  further. 

e.  The  Selection  of  the  Adaptive  Loop  Gain,  u 

Appendix  C,  section  C.  presented  few  factors 
related  to  the  selection  of  the  loop  gain.  The  first  is  the 
misadjustment , given  in  eq.  (C-63),  and  the  second  is  the  re- 
lated convergence  time  constant  given  in  eq.  . (C-64).  A more 
crucial  parameter  related  to  p,  is  the  stability  of  the 
adaptive  loop. 

In  Chapter  VIII  we  subjected  the  processing 
algorithm  to  the  assumption  that  no  a priori  knowledge  is 
available.  Based  on  this  assumption,  an  appropriate  auto- 
matic gain  control  ("AGC")  was  needed.  Various  gain  control 
loops  were  tested  and  the  selected  configuration  is  presented 
in  Fig.  7-9.  The  "AGC”  loop  major  design  requirements  were: 

1.  Under  all  possible  reasonable  initialization 
of  filter  coefficients  (WQ)  loop  stability  has  to  be  assured 
([selection  of  WQ  = 0 should  be  avoided  in  any  case)  . 

2.  For  any  external  selection  of  loop  gain 
constant,  C,  the  loop  should  not  diverge  (avoid  overflow). 

3.  The  steady  state  misadjustment,  independent 
of  background  noise  statistics,  should  be  the  same  and  should 
be  controlled  externally. 


r r 
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4.  Subject  to  the  above  stated  requirement,  it 
is  required  to  control  the  gain  so  as  to  yield  the  shortest 
adaptation  time  constant. 

The  following  measures  were  taken  to  satisfy  the 
listed  requirements: 

1.  In  order  to  avoid  divergence  of  the  filter 
output  under  any  circumstances  the  output  y(m,n)  is  limited 
to  a selected  maximal  value. 

2.  In  order  to  assure  a constant  "misadjustment" 

the  total  input  power  in  each  input  sample  set,  has  to  be 

calculated  to  get  the  estimate  of  (frace  r — )•  This  estimate 

XX 

is  required  since  the  misadjus tment  is  given  by: 

M a jj  • [trace*  R^]  . 

a 

While  estimating  (— ) by  A: , A2 , A3  in  Fig.  7-9,  an 

XX 

additional  constraint  is  imposed  on  the  trace  measurement: 

g2oo  • ♦ i/cioi  (7-n) 

As  the  filter  adapts  its  coefficients,  the  output  y becomes 
very  small  compared  to  and,  after  a limited  number 

of  adaption  steps,  if  indeed  convergence  is  achieved, 

G200  = . 

k§  indicated  in  Fig.  7-9,.  the  gain  constant  C can  be  set 
••rernally.  Therefore,  in  extreme  cases  when  a high  C is 
• • •*.  ted,  by  mistake  or  intentionally,  the  second  term  in 
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eq.  (7-12),  namely,  |y(k)l,  will  assuTe  the  gain  convergence, 

to  prevent  loop  divergence. 

As  the  filter  converges,  the  trace  estimate 

becomes  less  noisy  due  to  the  smoothing  operation  done  by  Aj. 

Eventually,  after  a few  hundred  adaption  steps,  the  loop  gain 

is  stable  and  can  be  locked  to  its  last  value,  as  demonstrated 

in  Fig.  7-9  by  the  memory,  A and  the  switch,  SW1. 

By  utilizing  the  "AGC"  configuration  presented 

in  Fig.  7-  9,  the  misadjustment  is  indeed  constant  under  all 

circumstances  since  the  loop  gain  u * C ~ ^ — and  the  mis- 

XX 

adjustment  given  by  ( C- 63)  is  M ■ M*tr  * C (constant). 
Then,  in  Appendix  C,  section  C,  the  adaption  time  constant 
was  calculated  as  well  and  was  given  by  (C-67)  (for  equal 
eigenvalues) . 


x = , L_  , i 

mse  4 y tr  4C 


! ] 


For  unequal  eigenvalues,  tmse  is  also  related  to  ^ but  in 
a more  complex  form. 

Therefore,  this  '’AGC”  configuration  could  yield 
the  required  performances,  for  a proper  selection  of  the 
constant  C.  For  example,  a misadjustment  of  10%  can  be 
assured  by  selection  of  C * ^ . Fixing  C will  result  in  a 
given  adaptation  time. 

In  order  to  accelerate  the  adaptation  period,  a 


gain  switching  option  was  tested  such  as  demonstrated  in  Fig. 

7-  9(b).  In  the  gain  switching  case,  an  initial  gain  constant, 


as  high  as  possible,  is  selected  to  achieve  a fast  conver- 
gence toward  steady  state.  After  a certain  number  of  adap- 
tation steps,  the  gain  constant  is  switched  to  a low  value  to 
assure  the  proper  required  misadjustment.  When  some  a priori 
knowledge  is  available  about  background  noise  statistics,  the 
gain  switching  point  can  further  optimize  the  performance. 

There  is  a clear  trade-off  that  limits  the  util- 
ization of  the  gain  switching  method.  Whenever  the  initial 
guess,  WQ  (the  initial  filter  coefficient)  is  close  to  the 
steady  state  solution,  applying  the  gain  switching  technique 
will  not  be  fruitful  and  sometimes  will  even  be  the  worst. 

On  the  other  hand,  when  initial  guess  of  W is  assumed  to  be 
far  from  the  steady  state  solution,  the  gain  switching  tech- 
nique will  indeed  shorten  the  adaptation  time. 

f.  The  Required  Number  of  Independent  Pixels  to 

to  Achieve  Adaptation 

Throughout  all  the  preceding  discussion  the  image 
statistics  were  assumed  stationary.  If  one  assumes  that  the 
stationarity  is  confined  to  limited  image  subzones,  the 
adaptive  filter  input  samples  should  be  confined  accordingly 
to  a subzone.  The  question  raised  is,  what  is  the  minimum 
number  of  independent  pixels  sufficient  to  achieve  filter 
adaptation?  Intensive  computer  simulation  indicated  that 
for  a 3x3  filter  size  a subimage  of  size  6x6  is  sufficient 
to  adapt  filter  coefficients.  It  was  noticed  that  adaptation 
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rate  is  slowed  down  as  the  number  of  independent  pixels  is 
reduced.  Simulation  results  for  small  size  image  filter 
adaptation  will  be  presented  at  the  end  of  this  chapter. 

E.  COMPUTER  SIMULATION  RESULTS 

1.  Introduction 

In  this  section  typical  computer  simulation  results 

will  be  presented.  The  type  of  filter  selected  to  be  presented 

is  a spatial  3x3  size  filter,  optimized  to  enhance  point 

targets  and  suppress  correlated  noise  with  variance  = 4 0 

CN 

The  following  plots  will  be  shown: 

1.  The  filter  coefficients  adaptation  plots,  compared  to 
the  theoretical  coefficients. 

2.  The  learning  curve  (MSE  as  a function  of  adaptation 
steps). 

3.  The  gradient  estimate  curve  as  a function  of  adaptation 
steps . 

The  simulation  procedure  was  conducted  in  the  following  way: 

1.  Generate  the  correlated  noise  image  with  specified 
statistical  properties. 

2.  Adapt  the  filter  coefficients. 

3.  Design  a theoretical  Wiener  or  matched  filter  based  on 
the  known  statistical  properties. 

4.  Plot  the  coefficients  adaptation  curve  compared  to  the 
theoretically  designed  coefficients. 

Three  sets  of  adaption  plots  will  be  presented: 

1.  Adaption  of  the  spatial  filter  to  an  image  with  first 
order  Markov  model  statistics. 

2.  Adaption  curves  for  second  order  Markov  model  clutter. 

3.  Small  size  image  adaptation  curves. 


2.  Adaption  to  First  Order  Markov  Model 

Fig.  7-10  presents  the  unprocessed  clutter  image 
generated  by  first  order  Markov  process  with  correlation 
factor 

PH  - py  - 0.99 

The  theoretical  filter  coefficient  and  the  steady  state 
adaptive  coefficients  are  shown  as  well  in  Fig.  7-10. 

Fig.  7-11 (a) , (b) , (c)  presents  the  filter  coefficients 
adaptation  curves  as  a function  of  adaptation  steps.  The 
theoretical  coefficients  level  is  presented  as  well  in  each 
adaptation  curve  and  it  is  seen  that  the  adaptive  filters 
coefficients  come  indeed  very  close  to  the  theoretical  value. 

Fig.  7-12  is  the  learning  curve  and  it  shows  the  MSE 
at  filter  output  as  a function  of  adaptation  steps. 

Fig.  7-13  shows  the  sum  of  the  absolute  values  of  all 
coefficients  correction  signals. 

3 . Adaptation  to  Second  Order  Markov  Model 

Fig.  7-14  presents  the  unprocessed  clutter  image 
generated  by  second  order  Markov  process  with  correlation 
factor 

PH  * PV  " °‘9S 

and  spatial  frequency 

8h  ■ By  * 0.628 

The  theoretical  and  the  steady  state  adaptive  filter  coeffi- 
cients are  shown  as  well  in  Fig.  7-14. 

Fig.  7- 15(a) , (b) , (c)  are  the  filter  coefficients 
adaptation  curves.  Fig.  7-16  is  the  learning  curve  and 
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l igure  7-10  Unprocessed  linage  and  Filter  Orientation 


HUM  CMMCIfal  «!•(  NWII.I  MB  1 Nf  Mi  1 1 Cat  MUW  CSfMClfBI  MWI  MMTIItf  MB  IMfSBfllCBL 


Figure  7 - 1 1 ( b ) Coefficients  Adaptation  Plots 
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Figure  7- 14  Unprocessed  Image  and  Filter  Orientation 
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Figure  7-16  Learning  Curve  Figure  7-17  "Coefficients  Error"  Curve 


Fig.  7-17  is  the  sum  of  the  absolute  values  of  all  coeffi- 
cients correction  signals. 

4 . Adaptation  to  Small  Size  Image 

Fig.  7-18  is  the  unprocessed  first  order  Markov  model 
clutter  image.  A section  of  6x6  pixels  is  selected  as  shown 
in  Fig.  7-18  to  adapt  the  filter  coefficients.  The  adaptive 
process  is  accomplished  within  this  small  size  section.  The 
resulting  fil«:;r  coefficients  adaptation  curves  are  shown  in 
Fig.  7- 19  (a)  , (b)  , (c)  . The  learning  curve  is  shown  in  Fig. 
7-20  and  the  sum  of  coefficients  correction  signals  is  shown 
in  Fig . 7- 21 . 

5 . Simulation  Results  Conclusions 

The  major  computer  simulation  results  conclusions  are 
described  below. 

- The  adaptation  rate  decreases  as  correlation 
coefficient  increases. 

- An  impirical  relation  was  approximated  to  indicate 
the  total  number  of  adaptation  steps  N1  (total) , as  a function 
of  pH  or  pv  and  SH  or  By. 

- For  the  first  order  Markov  process: 

N1  (total)  * k^l.O  - (Pmax)2] 
where  Pmax  indicates  the  higher  correlation  coefficient 
(between  pH  and  py) . Typical!/,  k^ = 2S0  - 500,  depending  on 
loop  gain  constant. 

- For  second  order  Markov  process,  the  following 
approximated  empirical  formula  can  be  used: 
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Figure  7-18  Unprocessed  Image  and  Filter  Orientation 
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N2(total)  a N1 (total) *[ (I  ♦ 1/cos  0 )] 
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- In  general,  it  was  noticed  that  the  adaptation 
rate  is  slower  in  the  second  order  Markov  process  than  in 
the  first  order  Markov  process. 

- The  adaption  time  of  a small  sized  image  is  slower 
compared  to  larged  sized  image  (by  large  image  it  is  meant 
that  the  image  size  is  very  large  compared  to  the  search  box 
size)  . 

> A complementary  study  with  regard  to  suboptimal 
filters  was  carried  out  in  the  study  phase  presented  in 
Chapter  VI.  One  of  the  conclusions  there  was  that  a sub- 
optimal  filter  designed  to  operate  in  the  presence  of  highly 
correlated  clutter  is  the  preferred  suboptimal  filter.  Com- 
bining this  conclusion  with  the  fact  that  adaptation  time  is 
slow  in  case  of  high  correlation  - it  is  always  recommended 
to  select  the  filter  initial  value  as  if  it  were  designed  to 
operate  with  the  highest  correlation  factor. 

F.  SUMMARY 

In  this  chapter  a spatial  adaptive  filter  concept  was 
discussed  and  implemented.  The  adaptation  method  presented 
in  the  chapter  is  applicable  for  enhancement  of  targets  of  a 
given  shape  cluttered  by  highly  correlated  noise. 

In  addition,  a practical  method  to  modify  a special  Wiener 
filter  - intended  to  detect  point  targets  - into  a matched 
filter  was  presented.  This  method  enables  a direct  adaptation 
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of  a matched  filter  in  the  case  of  point  target.  The 
suggested  method  was  tested  against  simulated  images  and 
demonstrated  the  expected  performance  - namely,  the  adapta 
tion  of  the  filters  into  a steady  state  optimal  solution. 

Various  practical  implementation  issues  were  mentioned 
in  the  chapter  such  as: 

- The  image  scanning  pattern 

- The  "desired  response"  derivation 

- The  adaptive  loop  gain  setting 

- The  typical  adaptation  rates 

- The  required  number  of  independent  pixels. 


This  last  issue  will  be  utilized  in  the  next  chapter 
where  nonstationary  statistics  will  be  assumed. 
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VIII.  ADAPTIVE  SPATIAL.  FILTER  II  - 

HgKSTATITOKRY  CLUTTER  STATISTICS 

A.  INTRODUCTION 

In  this  chapter,  an  adaptive  spatial  filter  technique 
capable  of  processing  images  having  nonstationary  clutter' 
will  be  developed.  Its  basic  idea  is  described  in  the  fol- 
lowing. More  detailed  explanations  will  be  given  in  following 
sections . 

The  first  assumption  is  that  an  image  of  nonstationary 
clutter  statistics  can  be  divided  into  subimages  within  which 
the  clutter  statistics  are  stationary. 

A spatial  filter  will  be  assigned  to  each  of  these  sub- 
images. An  adaptive  algorithm  is  then  applied  to  adapt  the 
assigned  filter  to  its  optimal  performance.  An  automatic 
procedure  is  applied  to  terminate  the  adaptation.  The  optimal 
filter  is  then  applied  to  the  subimage. 

Following  this,  an  optimal  threshold  will  be  determined 
and  applied  to  the  adaptively  filtered  subimage  for  target 
detection. 

B.  THEORETICAL  DEVELOPMENT  AND  PRACTICAL  CONSIDERATIONS 

1.  Subimage  Division 

In  this  thesis,  a procedure  of  dividing  the  image 
into  square  shaped  small  subimages  is  developed.  From  the 
processing  gain  requirements,  the  smallest  sub  image  size  is 
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preferred  because  the  chance  is  better  to  have  ’’stationary" 
statistics  in  a small  area.  This  makes  possible  the  design 
of  an  optimal  spatial  filter.  On  the  other  hand,  smaller 
subimage  site  requires  more  adaptive  filters  to  cover  a given 
image  size  and  increases  the  computation  load.  A trade-off 
should  be  made  for  an  optimum  subimage  size.  The  smallest 
size  used  is  6x6.  Using  this  small  size  and  simulated  images 
containing  Markov  model  correlated  noise,  it  was  found  that 
the  adaptive  filter  was  able  to  converge  to  the  optimal  value 
in  all  cases  tested. 


For  each  subimage,  adaptive  spatial  filters  developed 
in  the  last  chapter  can  be  used  because  we  assume  that  the 
statistical  properties  in  the  subimage  are  stationary.  There 
fore,  detailed  explanation  for  the  adaptive  spatial  filter 
will  not  be  repeated  here.  Instead,  only  the  important  steps 
will  be  highlighted  in  the  following. 

a.  Initialization  of  the  Filter  Coefficients 


It  can  be  started  in  two  ways.  We  can  assume 
a statistical  characteristic  and  design  a spatial  filter 
accordingly.  Alternatively,  we  can  calculate  the  statis- 
tical characteristics  of  the  image  by  ignoring  the  nonsta- 
tionarity  which  might  exist  in  the  image  and  design  a spatial 
filter  accordingly  and  use  it  as  the  initial  filter. 


b.  Selection  of  Adaptive  Loop  Gain 

It  was  discussed  in  detail  in  Chapter  VII,  section 
G.4.  In  our  computer  simulation,  a loop  gain  of  0.4  was  used 
most  frequently. 

c.  Termination  of  Adaptation 

The  procedure  to  terminate  the  adaptation  was 
discussed  in  Chapter  VII,  section  G.2.  In  our  computer  simu- 
lation, the  following  parameters  are  used: 

n » 36,  N ■ 360,  F » 51 

d.  Adaptation  Time 

It  depends  on  the  following  factors: 

Filter  initialisation 

Adaptive  loop  gain 

Statistical  characteristics  of  the  image. 

The  last  factor  is  beyond  the  control  of  the  filter  designer. 
However,  design  of  the  initialization  and  loop  gain  could  have 
a significant  effect  on  the  adaptation  time.  It  was  found, 
from  computer  simulation,  that  using  a loop  gain  in  the  range 
of  j to  -y,  it  took  at  most  several  thousand  adaptive  steps  to 
reach  the  optimal  filter  in  most  cases. 

C.  COMPUTER  SIMULATION  RESULTS 

1.  Generation  of  Nonstationary  Images 

The  nonstationary  image  used  in  this  chapter  is  the 
same  one  introduced  in  Chapter  VII,  section  G.4.  It  is  an 
image  of  size  64  x 64  pixels,  and  consists  of  four 
quadrants,  each  of  which  has  its  own  statistical  properties. 


L. 


They  are  separately  shown  in  Figures  8-1  through  8-4, 
which  include  their  statistical  properties  and  optimal  spatial 
filters  together  with  the  theoretical  processing  gain  of  these 
filters. 

Fig.  8-1  Upper  left  quadrant 
Fig.  8-2  Upper  right  quadrant 
Fig.  8-3  Lower  left  quadrant 
Fig.  8-4  Lower  right  quadrant 

The  composite  nonstationary  image  is  shown  in  Fig.  8- 5(a) 
by  a 9 gray  level  printout  and  in  8-5(b)  by  a 3-D  plot. 

2.  Image  Subdivision  and  Filter  Adaptation 

The  image  is  divided  into  square  shaped  subimages  of 
size  8x8  pixels,  as  shown  in  Fig.8-6(a).  An  adaptive  filter 
was  assigned  to  each  subimage  and  was  adaptively  changed  until 
it  reached  the  optimal  performance.  In  Fig.  8-6(b) the  adaptive 
filter  coefficients  of  several  selected  subimages  are  shown  and 
can  be  compared  with  the  theoretical  optimal  filter.  The 
resulting  processing  gain  and  optimal  threshold  are  shown  in  8-6(c). 
The  threshold  was  determined  by  assuming  Gaussian  probability 
density  function,  and  for  a probability  of  false  alarm  in  the 
range  from  l x 10* 1 <_  PpA  £ 5 x 10"3 

3 . Comparison  of  Filter  Performance 

The  following  figures  of  merits  are  used  to  evaluate 
the  filter  performance. 

For  clutter  suppression: 

a.  Processing  gain  (P.G.) 
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Figure  8-3(b) 


Three  Dimensional  Plot  of  Computer 
Generated  Lower  Left  Quadrant  Image 
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Figure  8-4(a)  Computer  Print  and  Statistical  Properties  of  Lower  Right  Quadrant 
Image  and  Its  Optimally  Designed  Spatial  Matched  Filters. 
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Figure  8-5(a)  Nine  Gray-level  Computer  Print  of  Four  Quadrant 
"Nonstationary"  Simulated  Clutter  Image. 
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Figure  8-5(b)  Three  Dimensional  Plot  of  "Four  Quadrant" 
"Nonstationarv"  Simulated  Clutter  Image. 
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The  Image  Division  to  Many 
Subimage  Zones 


Image 

Zone  1 
FILTER  1 


Image 

Zone  2 
FILTER  2 


Image 

Zone  3 
FILTER  3 


Image 
Zone  4 
FILTER  4 


Image 
Zone  J 
FILTER  J 
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Figure  8-6(a)  Division  of  a Given  Image  Into  Subimage 
Zones  for  Performing  Filter  Adaptation. 
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For  target  detection: 

b.  Probability  of  detection  (P^) 

c.  Probability  of  false  alarm  (PpA) 

Sets  of  comparisons  will  be  presented, 
a.  For  Background  Clutter  Suppression 

The  first  set  is  to  compare  adaptive  and  non- 
adaptive  filters  in  terms  of  background  clutter  suppression 
and  probability  of  false  alarm.  It  consists  of  five  figures. 

Fig.  8-7  shows  the  adaptively  filtered  and  thresh- 
olded  background  clutter  image,  using  a subimage  size  of 
8x8  pixels.  The  resulting  probability  of  false  alarm  is  also 
listed  in  Fig.  8-7. 

Fig.  8-8  shows  nonadaptively  filtered  and  thresh- 
olded  background  clutter  image  and  consists  of  four  figures. 

Fig.  8-8(a)  is  the  result  using  the  optimal  spatial  filter 
designed  for  the  first  quadrant.  Figures  8-8  (b) , (c)  and  (d) 
are  the  corresponding  results  using  spatial  filters  optimally 
designed  for  the  second,  third,  and  fourth  quadrants  respectively. 
Probabilities  of  false  alarm  for  each  case  are  also  listed  in 
these  figures. 

Comparing  Fig.  8-7  and  Fig.  8-8  revealed  that  the 
probability  of  false  alarm  of  the  adaptive  filter  case  is 
about  '22  times  lower  than  that  of  the  nonadaptive  filter  case. 

The  second  set  of  comparisons  is  similar  to  the 
first  set  for  comparing  clutter  suppression  and  PpA-  However, 
the  adaptive  spatial  filter  in  this  set  used  a large  subimage 
size  of  16x16  pixels.  Only  three  figures  are  used. 
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Adaptation  Subimage 
Zone 


THE  ADAPT  IV ELY  FILTERED  IMAGE 

probability  oc  false  alarm  is  0.0066 


Figure  8-7  Computer  Print  of  False  Alarms  of  Adaptively 
Filtered  and  Thresholded  Four  Quadrant 
"Nonstationary"  Simulated  Clutter  Image. 
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PROBABILITY  CF  FALSE  ALARM  IS  0.1431 


Figure  8-8(a) 


Computer  Print  of  False  Alarms  of  Nonadaptively 
Filtered  and  Thresholded  Four  Quadrant  ''Non- 
stationary" Simulated  Clutter  Image  Using  Spatial 
Filter  Optimally  Designed  for  First  Quadrant. 
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t ROBABILITY  OF  FALSE  ALARM  IS  0.1462 


Figure  8-8(b) 


Computer  Print  of  False  Alarms  of  Nonadaptively 
Filtered  and  Thresholded  Four  Quadrant  "Non- 
stationary" Simulated  Clutter  Image  Using  Spatial 
Filter  Optimally  Designed  for  Second  Quadrant. 
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PROBABILITY  OF  FALSE  ALARM  IS  0.1396 

Figure  8-8(c)  Computer  Print  of  False  Alarms  of  Nonadaptively 
Filtered  and  Thresholded  Four  Quadrant  "Non- 
stationary" Simulated  Clutter  Image  Using  Spatial 
Filter  Optimally  Designed  for  Third  Quadrant. 


219 


■ 


■W*u  ?'•  < 


•*5o7H5 


VV 

V 

V 

i 

V 

vv 

V 

V 

i 

vvv 

vvv 

V 

vvv 

« vv 

VVVV 

vvv 

V 

V 

V 

vv  vvv 

WV 

V 

vvvvv 

vvv 

V 

V 

V 

W VV  V 

vvv 

V 

V 

vvvvv 

vvv 

V 

vvvvv 

vvv 

V 

vvvvv 

vvv 

V 

• 

vvvvv 

vvv 

V 

vvvvv 

vvv 

VVVV.  V 

V 

vvvvv 

vvv 

VVVV  V 

V 

vvvvv 

vvv 

VVVV  V 

vvvvv 

vvv 

VVVV 

V 

V V 

vvvvv 

vvv 

VVVV 

V V 

V 

V V 

vvvvv 

vvv 

VVVV 

V V 

V 

vvv 

vvvvv 

vvv 

VVVV 

V 

vv 

vvvvv 

vvv 

VVVV 

v 

V V i 
V V 1 

V 

V V 

V vvv 

V vv 

V V 

V V 


vv 

V vv 

v vvv 

V V 

vv 

V V 

vvv 

vvv  vv 

vv 

V V 

vvv 

vvv  vv 

1 vvv 

v v 

VV  V 

VVVV  V 

i vvv 

V 

VV  V 

VVVV  V 

i VVVV 

V 

VV  V 

v vv 

VVVV  V 
VVVV  V 

v\v 

t V ' 


v v v vv 
v v v vv 

V vvv 

V V vvv 

V V VVV  V 


5? 

vv 

V V 

vvv 

vvv 

vv 

53 

vv 

V V 

V V 

vvv 

vv 

S4 

1/  vvv 

vv 

VV  V 

VVVV 

V 

55 

V vvv 

V 

vv  v 

VVVV 

V 

5o 

V VVVV  V 

VV  V 

V vv 

vvvvvvvv 

vvvvvvvv 

vvvvvvvv 

vvvvvvvv 

vvvvvvvv 

vvvvvvvv 

vvvvvvvv 

vvvvvvvv 


PROBABILITY  OF  FALSE  ALARM  IS  0.1335 

Figure  8-8(d)  Computer  Print  of  False  Alarms  of  Nonadaptively 
Filtered  and  Thresbolded  Four  Quadrant  "Non- 
stationary" Simulated  Clutter  Image  Using  Spatial 
Filter  Designed  Optimally  for  Fourth  Quadrant. 


Figure  8-9  shows  the  adaptively  filtered  and 
thresholded  clutter  image  and  its  PFA  ’ 

Figure  8-10  compares  the  performance  of  adaptive 
filters  using  8x3  and  16x16  subimage  areas.  It  can  be  seen 
that  a smaller  subimage  size  offers  better  results.  Figure 
8-10  indicates  that  in  7 out  of  16  (*3%)  subimage  areas  of 
size  16x16  a transition  in  the  statistical  properties  occurs 
inside  the  subimage  area.  On  the  other  hand.  Fig.  8-6(c) 
indicated  that  in  the  8x8  subimage  areas  the  transition  in 
the  statistical  properties  occurs  only  in  15  out  of  64  (25%). 
This  difference  explains  the  improvement  in  the  PFA  as  sub- 
image areas  size  is  reduced. 

Figure  8-11  shows  the  nonadaptive  filtered  and 
thresholded  image  using  a spatial  filter  optimally  designed 
for  the  lower  right  quadrant.  The  resulting  PpA  is  also 
listed  in  the  figure. 

Comparing  figures  8-9  and  8-11  revealed  that  the 
PpA  of  the  adaptive  filter  case  is  about  five  times  lower 
than  that  of  the  nonadaptive  filter  case.  The  difference  is 
not  as  big  as  a factor  of  22  for  the  smaller  subimage  size 
case  shown  in  figures  8-7  and  8-8. 

b.  For  Clutter  Suppression  and  Target  Detection 

The  third  set  of  comparisons  is  for  both  clutter 
suppression  and  target  detection.  For  this  purpose,  an  en- 
semble of  point  targets  shown  in  Fig.  8-12  are  added  to  the 
clutter  image.  The  resultant  image  is  shown  in  Fig.  8-13. 
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THE  ADAPTIVELY  FILTERED  IMAGE 
PROBABILITY  OF  FALSE  ALARM  IS  0.0078 


Figure  8-9  Computer  Print  of  False  Alarms  of  Adaptively 
Filtered  and  Thresholded  Four  Quadrant 
"Nonstationary"  Simulated  Clutter  Image. 
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Figure  8-10  Processing  Gain  and  Threshold  Level  for  Each 
16  by  16  Pixels  Adaptation  Subimage  Zone. 
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PROBABILITY  OF  FALSE  ALARM  IS  0.0383 

Figure  8-11  Computer  Print  of  False  Alarms  of  Nonadaptively 
Filtered  and  Thresholded  Four  Quadrant  "Non- 
stationary" Simulated  Clutter  Image  Using  Spatial 
Filter  Designed  Optimally  for  Fourth  Quadrant. 
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THE  ORIGINAL  TARGETS  IICATION 

TARGETS  LEVEL  IS  1*50000  TIMES  THRESHOLD  LEVEL 


Figure  8-12  Locations  of  Point  Targets  Added  to  the  Four 
Quadrant  "Nonstationary"  Simulated  Clutter 
Image  for  Calculating  Probability  of  Detection. 
225 


03*1"  B»43A343-»rj93E 

aj-jMMMVM  ia-»vM«MMMMMMdddMMMMMM£e€e©tf©aaaafliaa3iajaaj«a88e88e8a8s©f 

EH0e9MVVVM600MMMHMMM06€6€MMMMM'€6€fte©©0*4SittCaa*00etie€«090a060999‘: 
M^eGMvvv^^^-J^vvHHHtjeeeeMMMHMMe^eeeeaoflGGeetjtjeeeeee&e^aMMMMMMM*- 
8*a€l»VWM8-**0MVVMMM99009MMMMMMMMMMMMMMMMMMMMMMMMMNMMMMMMMMMMHMN 
VMe00eMVWMM08€00MMMMMMMVVWV«-<H"»-«-*«"»~*-V4-V  ♦VVWWVWWVVV 
0fl#a9M*>VMe4'»0MVWMM9e600MMMVMM  VVVVVV«-«-»--*-*«"*-**-*-«-«»WVVVVVVVVVVVVV 
§8806  •‘♦♦VMe499MVWMM00009MMMVMMMMVVVVVVVVVVVVVVVW  WWW  MMMMMMM  n 
iOtee«6l»>>V  l»-€€t€MVWMM09600MMMVMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMM 


4M4X*  8.3fc.3 

$V1N»  -9.8094 
-M(  *-0  1REC  TI  ONI 
* Ml  Y-OP  rCT  1 JN 

- >■»- 


3 

4i 

5p 
6 IE 
7p 
8 
9 


li 


it 

17fe 
16  |E 


19 

2 

2 

2c 


3$ 


ES«96V'*’-*-vM0440MvwMM0000eMM'xvM090QO>0#^04a9ai4#aa€9eeeGaeedO3e€ 

: 3 |E  « 6 f € V ♦♦  V ««€  M VV  V *40000  0 M M KV  »*<>0€€000i§09§il»M  00  000008 000000000  € 

_tSiivttvHif48MVVVMM0040iHMMVMHMMMMNHMHMMMMHMMHMMMMMMMNMHMMMNMM»* 
|Ee«#€V*"fVM6i«eMVVVMM00990MHMVMMMMMMVVVVVVWVVVVVVWVVVVMMMMMMVM* 
B900V*+ VM9440M  VVVMM90600MMMVMMMMVW  WWW  WW  VV  VWV  VV  V VWVWVV  I1 
-aS^^WMe^HMVWMMBBGeaMMMVMMMMVWVVWVVVVVVVVVVVVVVVWVMMVVMM 
(€€£€£  ►♦♦V  M6i§€MWVMM00000MMM  VMMMMMMMMMVW  WWVMMVMMMMMMMMMMMMMMM 
88«0M*'+VM€800MVVVM»*€>e€60MMMVMMMMMMMMMMMMMMMMMMMMMMMMMNMMMMMMMM* 

949  r»M»»v^8^93NWVMH08e89NHMV0MMHM0839000 0000000 9000066008838806 
fcflt«6M4V  M6886MWV  MMr^0e0eyMMVMM>X 300000000000030830 303Q80q003000€ 
9998 M V+  V M6€«0M  W V M M09600MMM  MMMH69€08888On€30O83ee8€86€0080e8836 
I9993MV* 

€9a8f|'M>MM30880VMVM09898BMM4MHaM0MMOMMeMqMMQMM300HH0MM6MOMMeMM0K 
fle96MV»VH6666MVVH0M66€€900MMMMMMMMHMMMHMMMHMMHHHMMMHHMMMHHMMMH» 

S^^MVVVM0060mvVHMN00€00MMMMMMNMMMHVWWVVWVVVVVVVVM9MMMMMMMM> 

8§eNMV*Me400*MMMM606§0BMMiMM§MM«4««MMVMVNVVMVV4VMVMMMMMNGMMQMMe* 

9e6NVWM0008MMMMM*M6€00MMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMM*MMMU 

B98Ma30M4vv>vvMe0HMvv^00ee0vsaaa8saaaBaB8Ui0889099080§0as9aaa0fl 

jao30M€3384Mv  -♦M«900vv^0aaBawevvvM39MeMMvvvv+wvvvvvvMMOMM«M»4ew 

^B0MH6€i6€€V V0€€6VM*60BIM[)M800MMOG#060MMHWV  WWW  VVVNMMMMM*m^ 

j£*f€MM0e00e0V-*-WOHH80000000»4MiH0VMP9M0MM4  VM  VVHVVVVHVVMVGMMtMVevi 
IG0-60I* V WMMMO80MMV  VM08S66MV  +V6MMMMVVVMM WVVVVVVVVW  ♦♦♦♦♦♦♦V  «-►«- 
mm0»jm^+>  vM89a44M  V VH30  000V — ♦ 8VVV  ♦+♦♦♦♦  ♦♦ ♦♦  »♦» -— - ♦♦♦♦♦V  <1 


23  3 

24  31 

25  g 

26  3 

27 

28 
29 

Iff 
I? 

34; 

l5i 

36 

37 

38 

39 

40 
4 
42! 
43 
44jl 

45 

46 

47 


ir 


4 

49p 

50 

51 

II p 

54 

55JN 

5o 

57 

58! 

59  M 

60  3 
6?  * 
62“ 
63 


teMfiB0VV-VV^'«S«3MMM3304M0V+MM9©08MMeHM0MMHVMWMVWVWWV0MH0VM8v 

J80  V+  — V V00aaS0MMHVMHfM0MVV  M€e0e9e0098884ee90MMMVMVVVVMMMMMMWM»i 
93HV+ WM909G000MVVVVM00€MV0690€0e990«30QNMMMMMMMMVWWVHVMM9M> 
teHM0€eiM4VMyvM00«9W  + +M4a9ta4»O4  990«9aa9af»S849000800MMMM9HP§90©fi 
pHE  »*P€i€€£  MM  V+  VM000  M V+  V M M0890  M€ €8 €0099 8 9999999999  098898HH03388086 
MVVM8B«30M^-4-V003MHVMHM9080e-*>WV*  VWVWVV  WWW  W VVWVWVVWVVV 
iMMV  VM€s)803MV  + ♦WMM  30006MMM000V  VV  VVVVVMMMM  V VVW  VV  VV  VV  VV  WV  W W V V V 
KMCV  VP<€£€«mWWVMO0006WVMM0WHMVMMMMM'XMM  VWVWVV  wvvwvwwvvv 
,PHMMMVM"6€0  O0MM  VW648SeMMVVM0V  MMMMMMMMMMMMMMMMMMMMMMV  MMVMMMMMMMm 
M0C0MVVV  MM04403V  W93000M  M VVVMHMM  MMMMMMMMMM  MMMMMM  MM MM MMMMMMMMMM M * 
I0H00MW+  MM-€iie€MVMM000MMMWV  MMMMMMMMMMMMMWMHMMMMMMMMMMMMMMMMMMMN 
M000  M V+ V M M0886  MMMMMMMMM0MMMMM0M£MM0M08**0M  MMMMMM  MM M MMMMMMMMMM M m* 
MB00MMV  '.'MMM06de00«  VVVMM33e>MMMMMMMMMM00e9MMMMMMMMMMMMMMMMMMMMMM» 
MMM999MMMMMMM9080MVVVMMe«09MM999M00.»8099>?MMMMMMMMMMMMMMMMMMMMMM 
(MM  MM  M000  H Mf*  VV  V M000  M V V VM  *<0000MM000000e0€003€e000e0000He9M9900»90fl 
[MMVv  M00900MW  VV000MMMMM1M909 0300 000099300400 3000000000€0Gee003ee 
MM M VM C0900 MM  V V VMMM M00 Mg M MM0e0€€06€e000€00000000300400ee00048009c 
M MMMMM034MM  MM  VMMM0000G  MMMMM06600009O0  0400 0080000060660000000006 
f,MMMMMMMM4000MMMVM90909MMVV  M0330 03899090000090 083990608300089906 
M90M WMMM03300MV M368€MMHVVMM8038e9ea9€938688883Q36€6e€e69336386 
mm0QMMVVMM00 403 MM MMM00MMMMMVM009 899900 098 0900000 00808€ 6690090 99€ 
tM£00MMVMMM0939M9MMMMMMM9MMMM900 9093086^399000800906906000983906 
INMO00MMMMMMM909360MMMM  MM800MM6€3000000€0ft90003909999000090909^e^ 
MMM999M  MMMMMM‘*099  MVV  MMM9900M0fl3O00800990G0008000€8660€€8900080^ 
M MM  M0000  MMMVM M€08  V M MM  MM0893 M0  O000000960000000039890008330999906 
HMMMM0300MMMVV  MM30MMMMMMM909M000 3009 990009 6099006006066 600900906 
M MMM 09099 MM VM^MMM  M9MMMMMMM990 99 90908 009000000000606 80€€08909906 
l9MvMMMO006MMMMMMMM666€0MMMM99000 900300094G9833030090G06 000099 00 6 
MMMMMMM0MMMMMM880PKMMMMMM4?04;T099fln9600  39a90QB99960099996899*»9 


fc^WMMMj 


THE  TARGETS  TOGETHER  WITH  BACKGROUND  NOISE 


Figure  8-13 


Computer  Print  of  Four  Quadrant  "Nonstationary" 
Simulated  Clutter  Image  Including  Added  Point 
Targets  Shown  in  Figure  8-12. 
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The  target  intensity  is  proportional  to  the  threshold  level 
at  each  subimage  zone. 

Figure  8- 14  presents  the  adaptively  filtered  and 
thresholded  image  in  which  all  false  alarms  have  been  removed 
so  that  the  probability  of  detection  can  be  calculated.  It 
is  included  in  the  figure. 

Figure  8-15  (a) , (b) , (c) , (d)  present  the  nonadaptively 
filtered  and  thresholded  image  using  spatial  filters  designed 
optimally  for  first,  second,  third  and  fourth  quadrants  respec- 
tively. Resulting  probability  of  detection  for  each  case  is 
included  in  corresponding  figures. 
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THE  ADAPTIVELY  FILTERED  IMAGE 

Figure  3-14  Computer  Print  of  Adaptively  Filtered  and 
Thresholded  Four  Quadrant  "Nonstationary" 
Simulated  Clutter  Image  Including  Added 
Point  Targets. 
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PROBABILITY  OF  DETECTION  IS  0.731 

Figure  8-15(a)  Computer  Print  of  Nonadaptively  Filtered  and 

Thresholded  Four  Quadrant  "Nonstationary" 
Simulated  Clutter  Image.  Spatial  Filter  Used 
was  Designed  Optimally  for  the  First  Quadrant 
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PROBABILITY  OF  DETECTION  IS  0.694 


Figure  8-lS(c)  Computer  Print  of  Nonadaptively  Filtered  and 

Thresholded  Four  Quadrant  "Nonstationary" 
Simulated  Clutter  Image.  Spatial  Filter  Used 
was  Designed  Optimally  for  the  Third  Quadrant 
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PROBABILITY  OF  DETECTION  IS  0.823 


Figure  8- 15(d)  Thresholded  Four  Quadrant  "Nonstationary" 

Simulated  Clutter  Image.  Spatial  Filter  Used 
was  Designed  Optimally  for  the  Fourth  Quadrant. 
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D . SUMMARY 

An  adaptive  spatial  filter  algorithm  based  on  least  mean 
square  criteria  and  using  a steepest  descent  technique  is 
shown  to  be  effective  in  suppressing  nonstationary  clutter 
based  on  computer  simulation  of  Markov  model  clutter  noise. 

The  probability  of  false  alarm  of  the  adaptive  filter 
case  is  lower  than  that  of  nonadaptive  filter  case  by  S to 
22  times  for  the  examples  used  in  this  study. 

The  probability  of  detection  of  the  adaptive  case  is 
slightly  better  than  that  of  the  nonadaptive  case  when  the 
threshold  level  is  kept  equal  for  both  cases.  It  must  be 
emphasized  that  PpA  for  the  nonadaptive  case  is  5 to  22  times 
higher.  On  the  other  hand,  if  a CFAR  detection  is  applied 
by  adjusting  the  threshold  for  the  nonadaptive  case,  severe 
reduction  of  will  occur. 
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IX.  SUMMARY  AND  CONCLUSIONS 

A.  SUMMARY 

1.  Introduction 

New  infrared  surveillance  and  guidance  systems  using 
large  mosaic  detector  array  focal  planes  require  the  detec- 
tion of  targets  deeply  buried  in  background  clutter  noise  by 
several  tens  of  db's.  New  image  processing  techniques  must 
be  developed  to  accomplish  these  heretofore  unachievable  goals. 
They  must  also  be  relatively  straightforward  so  that  on-board 
implementation  using  moderate  LSI  signal  processors  is  pos- 
sible to  meet  real  time  processing  requirements.  They  should 
also  be  flexible  enough  so  that  a focal  plane  processing 
algorithm  is  able  to  adapt  itself  to  changing  background  scenes. 

This  thesis  develops  five  focal  plane  processing  pro- 
cedures which  consist  of  nonrecursive  statistical  filters  for 
background  clutter  suppression  followed  by  thresholding  to 
initiate  the  target  detection.  Nonrecursive  approaches  are 
taken  because  they  make  extensive  use  of  both  the  spatial  and 
temporal  behavior  of  the  image  signal  in  the  neighborhood  of 
the  pixel  of  interest.  On  one  frame  of  the  image,  signals 
of  pixels  all  around  the  pixel  of  interest  are  used.  In 
addition,  signals  at  the  same  pixel  location  from  other  frames 
before  and  after  the  frame  of  interest  are  also  used  in  the 
focal  plane  processing.  New  integrated  circuit  tapped  delay 

( ) 


line  devices  may  be  used  effectively  for  their  hardware 
implementation.  Statistical  approaches  are  used  because  it 
is  believed  that  a collective  statistical  description  can  be 
found  for  different  background  scenes  if  they  belong  to  the 
same  class  of  terrain,  weather  conditions,  etc.  Therefore, 
it  is  possible  to  design  a statistical  filter  which  is  able 
to  estimate  a weak  target  buried  in  noise  and  is  not  limited 
to  only  a few  background  scenes. 

The  concept  of  using  nonrecursive  statistical  filters 
for  background  clutter  suppression  was  originated  by  Lt.  D. 
Bar-Yehoshua  [14]  in  his  development  of  nonadaptive  spatial 
filters  based  on  the  minimization  of  mean  square  error.  This 
thesis  made  extensive  extension  and  more  thorough  developments 
of  four  nonadaptive  filters  in  both  spatial  and  temporal  do- 
mains. In  addition,  a new  adaptive  spatial  filter  is  developed. 

2.  Nonadaptive  Focal  Plane  Processing 

In  Chapter  II,  the  basic  concept  of  the  nonrecursive 
statistical  filter  is  expandeu  and  generalized  to  include  all 
nonadaptive  and  adaptive,  spatial,  temporal  and  mixed  spatial- 
temporal  or  temporal -spatial  filters.  A unified  processing 
concept  is  presented  for  clutter  suppression  based  on  the 
statistical  spatial  and  temporal  behaviors  of  the  image  in 
the  neighborhood  of  the  pixel  of  interest.  Two  statistical 
criteria  for  filter  design  are  introduced.  One  is  based  on 
the  minimization  of  mean  square  error  criterion  which  leads 
to  the  MMSE  filter  or  Wiener  filter.  The  other  is  based  on 
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the  maximization  of  signal  to  noise  ratio  criterion  which 
leads  to  the  statistical  matched  filter. 
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Detailed  developments  of  the  principles,  configura- 
tions, and  design  procedures  for  the  filters  are  developed 
in  Chapter  III  for  spatial  filters  using  a single  image 
frame  and  in  Chapter  IV  for  sequential  spatial- temporal 
filters  using  several  frames  of  images.  These  three  dimen- 
sional statistical  filters  are  useful  in  situations  when 
multiple  frames  of  images  are  available,  either  when  the 
surveillance  and  guidance  systems  are  already  in  their  track- 
ing modes  after  the  targets  have  been  acquired  or  when  the 
fields  of  view  of  the  systems  are  stabilized  to  cover  an 
area  for  a number  of  frames . 

In  Chapter  V,  the  thresholding  procedure  for  a two 
dimensional  image  is  developed  for  the  initialization  of 
target  detection.  Two  CFAR  (constant  false  alarm  rate) 
procedures  to  set  the  threshold  level  are  developed.  One 
is  for  Gaussian  probability  density  functions.  The  other 
is  for  the  more  general  non-Gaussian  PDF. 

In  Chapter  VI,  the  background  clutter  suppression 
filters  and  thresholding  are  combined  together  in  four  non- 
adaptive  focal  plane  processing  procedures.  Their  properties 
and  performance  are  studied  in  detail,  using  two  types  of 
images.  One  type  is  a set  of  twenty  frames  of  real  world 
infrared  images  with  10%  uniform  drift  between  frames.  The 
second  type  is  computer  generated  images  which  use  two  Markov 
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processes  to  model  the  correlated  noise  which  is  assumed  to 
be  a good  simulation  of  the  real  world  background  clutter. 

It  has  recently  been  brought  to  our  attention  that  the  Markov 
model  was  found  to  be  an  acceptable  simulation  of  the  back- 
ground clutter  based  on  recent  work  on  a tactical  infrared 
hostile  weapon  location  system.*  With  the  computer  generated 
model,  a wide  variety  of  images  with  varying  statistical 
properties  can  be  generated  with  ease. 

Both  background  clutter  suppression  performance  and 
target  detection  performance  are  evaluated  by  computer  sim- 
ulation using  both  types  of  images.  Using  the  real  world 
infrared  images,  a background  clutter  suppression  of  27  db 
is  achieved  by  a single  frame  spatial  filter.  Using  a five 
frame  spatial- temporal  filter,  a suppression  of  87  db  is 
achieved.  These  results  are  the  most  important  testimony 
of  the  practical  usefulness  of  the  nonadaptive  statistical 
filters  because  they  have  been  used  by  other  research  groups 
and  considered  as  one  of  the  "standard”  test  scenes.  Com- 
parison with  results  of  other  groups  is  difficult  in  this 
unclassified  study  because  the  absolute  calibration  of  the 
image  signal  is  a classified  number  and  was  not  made  avail- 
able. It  should  be  acknowledged  that  the  real  world  infrared 
image  test  described  by  figures  6-11  to  6-18  was  made  by 
Captain  D.  Hilmers  and  was  reported  originally  in  Ref.  30. 

*J.  Otazo,  MIT  Lincoln  Laboratory,  private  communication, 
and  to  be  presented  in  the  SPIE  1979  symposium,  Washington, 
D.C. , April  17-18,  1979. 
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3 . Adaptive  Focal  Plane  Processing 

In  Chapters  VII  and  VIII,  adaptive  statistical  spatial 
filters  based  on  the  minimization  of  mean  square  error  cri- 
teria are  developed  for  clutter  suppression.  In  Chapter  VII, 
the  adaptive  procedure  is  developed  using  computer  generated 
"stationary"  images  whose  statistical  spatial  correlation 
properties  are  uniform.  In  the  following  chapter,  the  pro- 
cedure is  applied  to  computer  generated  "nonstationary"  images 
which  have  four  different  statistical  spatial  correlation 
properties  in  a given  image.  It  is  found  that  using  a small 
adaptive  array  of  8x8  pixels,  better  clutter  suppression  can 
be  achieved  compared  with  nonadaptive  statistical  spatial 
filters.  Using  the  adaptive  approach,  the  resulting  proba- 
bility of  false  alarm  (PpA)  of  the  adaptively  filtered  and 
thresholded  image  was  found  to  be  more  than  twenty  times 
better  than  that  of  the  four  possible  nonadaptive  filters. 

B.  CONCLUSION 

In  conclusion,  five  nonrecursive  statistical  focal  plane 
processors  have  been  developed.  The  usefulness  of  this  new 
concept  of  clutter  suppression  has  been  demonstrated  by  apply- 
ing these  nonadaptive  filters  to  a set  of  real  world  infrared 
images.  Although  the  adaptive  spatial  filters  have  been 
tested  on  computer  generated  images,  it  is  believed  that  good 
clutter  suppression  can  also  be  achieved  on  real  world  images. 
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Neither  the  concepts  of  nonrecursive  filters  nor  that  of 
statistical  estimation  are  new.  However,  the  combination  of 
these  two  concepts  to  process  two  and  three  dimensional  images 
of  very  low  signal  to  noise  ratio  for  suppression  of  "colored” 
clutter  noise  and  for  substantial  enhancement  of  target  signal 
to  noise  ratio  up  to  several  ten’s  of  db's  has  not  been 
reported  before.  The  contributions  of  this  thesis  to  the 
advancement  of  focal  plane  processing  techniques  for  the 
enhancement  of  point/line  targets  and  the  suppression  of 
clutter  are  highlighted  in  the  following. 

1.  Nonadaptive  Focal  Plane  Processing 

a.  One  dimensional  statistical  estimation  techniques 
based  on  the  minimization  of  mean  square  error  criterion 
(Wiener  filter)  and  the  maximization  of  signal  to  noise  ratio 
criterion  (matched  filter)  are  extended  to  two  dimensions  for 
a single  frame  and  to  three  dimensions  for  multiple  frame 
focal  plane  processing.  They  are  different  from  other  mul- 
tiple dimensional  image  processing  studies  because  special 
emphasis  is  given  to  the  suppression  of  clutter  which  is 
modeled  by  correlated  noise.  Furthermore,  target  signals 
several  ten's  of  db's  below  clutter  noise  are  considered. 
Images  of  such  low  signal  to  noise  ratio  have  not  been  con- 
sidered until  motivated  by  the  recent  interest  in  smart  sensor 
systems . 

b.  The  clutter  suppression  is  accomplished  by  per- 
forming an  estimate  of  the  target.  This  is  different  from 
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other  approaches  which  first  estimate  the  clutter  and  then 
suppress  it  by  subtraction  from  the  estimate  of  the  target  signal. 

2.  Adaptive  Focal  Plane  Processing 

a.  One  dimensional  nonrecursive  adaptive  filter 
techniques  based  on  the  least  mean  square  criterion  are  ex- 
tended to  two  dimensional  single  frame  focal  plane  processing 
with  special  emphasis  on  the  suppression  of  correlated  clutter 
noise  several  ten's  of  db's  higher  than  the  signal  of  interest. 

b.  A procedure  to  derive  the  desired  response  corre- 
sponding to  different  types  of  target  signals  is  developed 
which  is  used  in  the  adaptive  process  as  the  optimal  response. 

c.  The  adaptive  loop  gain  is  set  by  an  "automatic 
gain  control"  procedure  which  includes  several  requirements 
simultaneously  to  yield  constant  misadjustment  for  varying 
statistical  properties  of  the  clutter,  to  prevent  overflow 
and  to  assure  adaptive  convergence. 

d.  A procedure  for  dividing  images  whose  statistical 
properties  are  nonstationary  and  unknown  a priori,  into  sub- 
image zones  for  filter  adaptation  is  developed  which  minimizes 
the  degree  of  nonstationarity  and  improves  the  performance  of 
adaptation. 


I 


1 


S 


(J 

« J 


240 


r 


APPENDIX  A [Ref.  14] 

GENERATION  (MODELING)  OF  TWO-DIMENSIONAL  RANDOM  FIELDS* 

A.  INTRODUCTION 

Any  monochromatic  image  can  be  modeled  by  specifying  its 
value  (gray  level)  f(m,n)  at  each  spatial  coordinate  (m,n). 

An  ensemble  of  such  images  can  be  modeled  by  interpreting 
f(m,n)  as  a random  field.  A class  of  images  with  particular 
spatial  correlation  can  be  modeled  by  a random  field  with 
the  same  autocorrelation  function. 

When  spectral  factorization  in  two  dimensions  is  possible 
[Ref.  36.]  , the  autocorrelation  function  of  a random  field  is 
related  to  the  transfer  function  of  a system  that  generates 
the  random  field  from  a set  of  uncorrelated  variates.  Then, 
specifying  a class  of  images  by  their  autocorrelation  func- 
tion specifies  a dynamic  model  representation  for  these  images. 

For  a discrete  random- field,  the  dynamic  model  is  a 
partial  difference  equation  that  can  be  represented  by  a two 
dimensional  recursive  relation.  The  problem  in  this  Appendix 
is  to  find  a linear  equation  that  represents  a given  random 
field.  A discrete  two  dimensional  random  process  with  two 
kinds  of  autocorrelation  functions  will  be  considered. 

The  presented  method  uses  the  spatial  frequency  domain 
to  generate  the  requested  random  field. 

*Excerpt  from  thesis  by  D.  Bar- Yehoshua,  "Two  Dimensional 
Nonrecursive  Filter  for  Estimation  and  Detection  of  Targets," 
Naval  Postgraduate  School,  June  1974  [14], 
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B.  SPATIAL  FREQUENCY  DOMAIN  METHOD  (TRANSFER  FUNCTION) 

1.  Introduction 

The  discrete  power  transfer  relation,  for  linear 
filtering  of  random  signals,  is  useful  for  designing  signal 
processors.  If  we  like  to  generate  a random  field  with  given 
autocorrelation  function,  we  can  find  a transfer  function 
through  which  an  uncorrelated  random  field  at  the  input  (white 
noise),  will  give  a defined  discrete  power  spectrum  density  at 
the  output. 

Figure  A- 1 shows  the  relationship  between  a white 
noise  input  signal  passing  through  a linear  filter  and  the 
resulting  output.  In  this  case,  the  discrete  power  density 
of  the  input  is  the  2-D  unity  function,  and  the  discrete 
power  density  of  the  output  equal  to  the  absolute  square  of 
the  filter  transfer  function. 

The  transfer  function  method  procedure  can  be  written 
as  follows: 

a.  From  the  autocorrelation  function  of  the  random 
fieii  *o  be  modeled,  find  the  discrete  power  spectral  density 
using  2 transform. 

S (Z1 , zt)  * Z(R(m,n) } (A-l) 

b.  Assume  that  the  discrete  power  spectral  density 
is: 

S(z1>22)  - |H(z1j22)|2  - H(z1>z2)*H(z1'>1  z,'1)  (A~  2) 
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Try  to  separate  SCz^  z 2 ) in  order  to  get  H(z^  Z2)  as  a trans- 
fer function  of  the  random  field  model,  according  to  eq.  A- 2. 

c.  Using  an  uncorrelated  random  field  as  an  input  to 
H(z^  z2),  find  the  dynamic  model  of  the  designed  random  field 
in  the  z domain. 


G(z1>z2)  = H(zljz2)*u(z1>z2)  (A- 3) 

where  u(z^  z2)  is  a random  white  noise  signal. 

d.  Convert  the  dynamic  model  to  a spatial  model  by 
inverse  z transform.  In  this  process  it  is  assumed  that  the 
random  field  is  stationary  and  ergodic.  In  this  section  the 
dynamic  model  for  two  autocorrelation  functions  will  be  con- 
sidered. 

2.  Dynamic  Model  of  One-Dimensional  1 , 

Autocorrelation  Function  R(i)  = °p*p 

Given  the  autocorrelation  function  of  one-dimensional 
random  signal  as: 

R(m)  * aR‘P^  (A-4) 


The  discrete  power  spectral  density  will  be: 


SCO 


°r2’C1-p2) 

(1-pz)  • (1  - pz'1) 


(A-  5) 


aD./T77 

K 

1 - pz 


a • jL 
R 


1 - pz 


■ p 

^T 


H(Z)  HCz'1) 


So,  the  transfer  function  will  be 
H(z) 


aR* 


(A-6) 


1-pz 
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--  


and  the  output  tor  such  trunster  lunction: 


g(z)  » HU)-h(z) 


. Pz  * 1 


F(z) 


If  we  replace  the  mpu*  by  white  noise,  we  will  get 
"le  dynamic  model  in  z domain: 


-1. 


g(z)  * pz  -g(z)  ♦ Or 
or  in  time  domain: 


♦ OnYl-p2  M 


U(Z) 


(A-7  ) 


/ 7~1 

g(n)  = pg(n-l)  + o^fl-p  u(n) 


( A- 8 ) 


where  u(nl  is  a white  noise  with  variance  » 1. 


Eq.  C A- 8 ) represents  a dynamic  model  for  a one-dimensional 
first  order  Markov  process. 


3 . Dynamic  Model  of  One-dimensional  Autocellerat ion 
Function  R(n)  ° lril»cos{u>»n) 


Given  the  autocorrelation  function: 

2 J n| 


R(n)  * u p • p Lcos((ii*n^ 


(A-9  ) 


The  discrete  power  spectral  density  will  be: 

a ♦ bz 


S(z)  » aR2.(l-p2)‘ 




( 1-  2p*cos  u z ♦ p -z  ) 


a ♦ bz 


- 1 


n T~rr 

(1-  2p*COS  u>z  + p *z 


(A- 10) 


where 


f 1 - 2p»c?s  iii  » p2  + 1^1  + 2p«cos  ai  ♦ p2 


fl  - Zc'CQs  a)  ♦ p2  ~ - fl  + 2p  cos  a)  + pZ 

2 


(A- 11) 


Note:  1-2  cos  w *■  c > 0 for  0 < p < 1 
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we  will  get: 

g(l)  - oR.u(l) 

g (2)  - 2p*cosw  g(l)  ♦ -jj^l-  p • [au (2)  ♦ bu  ( 1)  ] . 

(A- 1 5 ) 

b.  Second  way  - state  variable  representation 


Let  us  define: 


so  that: 


G(  z)  « H(:)‘  z’  *•  F1  U) 


* 

1 - 2p*cos  wz  * * ♦ p . z 


C A - 1 7 ) 


G ( z ) • 2'P‘COs  u*  z »G(z)  -P«2  z *.2G(z)  ♦z  ^F'(z)  (A-18) 


Let  us  define 


Px(i)  2 G(z) 
p2(z)  2 pZ.z’l.G(z) 


From  eq.  (A-18)  and  eq.  (A-19).  we  get: 


(A  - 1 9 ) 


Px  ( z)  • 2p*cos  w-z*  Px(z)  - z*1*p2(2)  ♦ z*Z,f'  (z) 


P 2 ( z ) " <>•  z'^Pj^z) 
Its  expression  in  the  time  domain  is: 


p^Cn)  ■ 2p*coswpx(n- 1)  - p2(n-l)  ♦ f '(n-l) 
p2(n)  • P2.  px(n- 1)  ( 


(A-20) 


Expressing  eq.  (A-20)  in  the  state  variable  form,  we  have: 


Px(n) 

P2U) 


2P*cos  w 


-ll  f Pl(n-1)  1 f 1 
- . 1 ♦ *f' 

0 p2  (n-l)  0 

L *•  J i 


(n-l) 


for  n > 1 


(A- 21) 


where  the  output  is  defined  as: 


g(n) 


Px(n) 

P2U)_ 


( A - 2 2 ) 


and  f'  (n-l)  *[au(n)  ♦ bu(n-l)] 

where  u(n)  is  a wh.te  noise. 


> % 7 


Pi  (1) 

p2(l) 


The  initial  cond  i t ion  is : 


oR*  u(l) 


4.  Dynamic  Model  of  Two-dimensional  2 imi  ini 
Autocorrelation  Function  R(m,n)  ■ oR  • • Pv 


Given  the  autocorrelation  function 


„ , . 2 I m I Ini 

R(m,n)  - oR  . ph'  1 . Pv 1 


(A- 23) 


the  discrete  power  spectral  density  is  (using  eq.  A-S): 


S ( 21 , 2 2)  * 31vz1)*S2(i2)  - 


°R2,(1-ph2K1-pV2) 


R v Hh  ' 

— — i 1 , r\.  241 

(l-Pb-iiHl-Ph**!'  Hl-V^^’V2^  ] 

\ — Ilf.  _ \ . Lt  / . " ^ ^ 1 a AC  * 


Separating  SCz^  i2)  t0  H^zl f z2^  *H^zl  # z2  ^ gives: 


H(i.  i2>  ' rr rrr 

1 • 2 (i-Ph*2!  H1‘pv22  > 


(A-2S  ) 


and  the  output  of  such  transfer  function: 

G(z1,22)  " H(21 ,Z2) *uCzi,z2) 

v.elds  the  following  recursive  equation: 


G(zl,22)  * -s’  z1*1*G(z1,22)  ' ph*pv‘2l  1#Z2  1*G(21,Z2) 


z21*G(z1,Z2)  * °/C1"phZ)*(1‘pvZ)*,u(zl.l2) 


( A-  26) 
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The  dynamic  model  in  spatial  domain  will  be: 

g(m,n)  » Phatf(m-l(n)  - Ph«pv • g (m- 1 ,n- 1)  ♦ Pv»g(m,n-1) 

♦ oR f (!-Ph2  H1*PV2  )'  * u(m,n)  CA-27) 

for  m,n  > 1 

Equation  (A-27)  is  a two  dimensional  first  order  Markov 
process  representation. 

The  initial  condition  will  be: 


g(l.l)  * °R*U(1>1) 

(A- 27) 

g(m,l)  - Ph*g(m-l,l) 

♦ °R^l‘PhZ  *u(«i1) 

a > 1 

g(l,n)  - Pv*g(l,n-1) 

♦ °r^ W,2  *uU»n) 

n > 1 

where  u(m,n)  is  white  noise  with  variance  1. 

This  dynamic  model  was  used  by  Habibi  [Ref.  17]  and 
can  be  characterized  in  a state  space  structure  [Ref.  18]  by: 


Uynuaic  Model  ot  Two- Jimensiona 1 
Autocorrelation  Function 


Or“*  t>h  •%  ^°*(«h-m)co*(“v-n) 


Given  the  autocorrelation  function: 


R(m,n)  » aR2.ph'm!pv'nLcos(u»h*m)  *cos(wv*n) 


(A  - 3 0 ) 


The  discrete  power  spectral  density  (using  eq.  A-10)  is: 


S(zlfz2)  * SUX)  • S(z2) 


Hl(*1)  * H1(z1‘1)  * H2(z2)  • H2  (z2*  X)  (A - 3 1 ) 


where 


HCzl\i2)  ’ Hl(2l1)‘H2(z21) 


°/(l-Ph2Hi-Pv2)' 


where 


(ah  ♦ b^1'1)-(av  + b^z^1) 


(l-2p^cos  +ph*zl  )*(l*2p^cos  o^z2  *pv» 


1- Zp^cos  u>h  ♦ p^  > [ l+2p^cos  u»h  ♦ p^ 


1-  2p^cos  o)h+ 


l«-2o^cos  oi^  ♦ ph 


1- 2P^cos  ujv  ♦ pv  ♦ j l + 2p^cos 


' 2^  J 2 

1 20*C0S  w ♦ p - 1 1 ♦ 2o*.cos  U»  ♦ p.. 


(A  - 3 2 ) 


( 


The  output  of  the  transfer  function  of  eq.  (A- 32)  is; 


cu,  :2)  ■ VUUlt*2) 

Calculate  G(ij  z^)  and  make  the  two-dimensional  inverse  z 
transform,  the  dynamic  model  in  spatial  domain  will  be: 


g(m,n) 


Cv-g(m,n-l)  - Pv-g(m,n-2) 


♦ C^g(m-l.n)  - Ch‘Cv*g(m-l,n-l)  ♦ Ch*py2  *g(m-l,n-2) 

' oh2g(m-  2,n)  ♦ Ph2  *Cv*gCm-2,n-l)  - p2h*py^g(m- 2,n- 2) 


°R*'  ^1_ph  Hl-Pv‘  ) *fah*av»u(m,n)  ♦ aK*a„*u(m,n- 1) 


h v 


where 


♦ av*bh*u(m"  1 »n)  * t>h*bv*u(m-l,n-l)  J 
for  m,n  > 2 


Ch  - 2>Ph‘cos  wh 


cv  • 2 • py*cos  u»v 


and  u(m,n)  is  an  uncorrelated  random  field  (white  noise). 
The  initial  condition  is: 


(A- 34 ) 


a-  g(i, 

J) 

- u(i, 

j)  • 0 

when  i 

or 

j < 1 

CA 

b.  g(l, 

- oR.  u(l  ,1) 

g(m, 

,D 

- for 

m > 1 

• use  eq 

. 1 

[ A-34) 

with 

p "0 

V 

and  u»v  ■ 

0 

and  (eq. 

A- 

•35) 

g(l. 

. n ) 

• for 

n > 1 • 

■ use  eq. 

( 

A-34) 

with 

°h  ■ 0 

and  ■ 

0 

and  eq. 

(A- 

•35)  . 

Equation  (A-34)  13  a two  dimensional  second  order  Markov 
process  representation. 
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An  example  of  an  image  1 00  x 1UU  in  size,  formed  by 
equation  (A-3*»),  representing  the  given  autocorrelation  func- 
tion eq . ( A - 3 0 j is  shown  in  Fig.  A- 1 In  this  picture  we  used 

ph  " °v  * °-y9  and  °R  “ 1 anJ  “h  * uv  * 0.143.  Comparison  of 
the  correlation  cunction  R(m,n)  of  the  simulated  image  to  the 
given  image  yielded  an  average  error  of  the  correlation  factor 
around  11. 

The  state  space  structure  can  be  found  as  follows: 


Let  us  define: 

ul(212z)  * 4z2*u(2l,z2>0R^(1'ph2)  (1'pv2)*(ah  * blizl  1)*(av"  bvz2~2  > 


we  get: 


(A»36) 


G(Zi  z2) 


2 2*  *u  (z1,22) 


(1-2p^cos  u>h  ♦ Ph.zx'2  (l-2p^cos  u»y  ♦ py4z2  ~L) 


t A- 37) 


By  using  the  following  definition 


pl(zl,22)  * '21  1'ph2’p2(2l,22)  * tl’1,p4(Il,t2)  (A'38) 


p2<zl.z2> 


l{  •p4<zl,22) 


(l-2*z1'i*ph.cos  o>h  ♦ ph^  *Zj  ) 


P3(Z1,Z2)  * 'Pv2*z21  *P4(z1.Z2) 


_ . x D z2  1 *ul(zl,z2) 

p.(z.  Zp)  * — 71 5 ; 

(l-2*pv-costt»v*z2  *oy.z2 


G(z1>z2)  . P2U1#Z2) 


(A- 39) 


(A- 40) 


(A- 41) 


(A- 42) 
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Figure  A-2  - A random  field  given  by  the  auto- 
correlation function  R^^.(m*n)  = 

°R2,ph  m *PV  n *cos  (wm*m)cos(ujn*n) 

forming  computer,  using  the  dynamic 
model  of  eq.  (A-30) . (The  picture 
is  presented  by  9 level  gray  scale) 
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i {-J 


liq  . ( A- 37)  can  lie  represented  as: 

I»,(2,,i2>  • 2ph-C0i  p2(:lj22)  * *!**•?!(*!  *2) 


* •°v2-z2'l‘P4<zl.z2) 


( A- 43) 


p4(4l>22)  - 2pvCOSa,v-22-1.p4(2lj22)*22-1-p3(2lil2) 

* 42‘1  •<*l(*l>«2) 

Converting  eq.  (A-43)  to  spatial  domain  and  putting  in  state 


variables  form,  we  get: 


p^m+l.n) 
p2(m+l,n) 
P3(m,n-*-l) 
P4 (®»n+l) 


_°_  L 3 _l°J  1 - 

Zp^-cos  u»h|0  | 0 

0 | 0 lot  -P  2 


Pj^Cm.n) 

p2(m,n) 

p3(m,n) 


0 ^”l  [7p -cosw  p4(ra,n) 

I I it 


. u (m, n) 


(A- 44) 


where 


g (m ,n)  * [0  1 0 0] • 


p1(m,n) 

p2(m,n) 

p3(m,n) 

P4(m,n) 


and  u (m,n)  is  an  uncorrelated  random  field  given  by: 


n 
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APPENDIX  B 
BAYES  CRITERION 

A.  REVIEW  OF  ONE  DIMENSIONAL  CRITERION  [32] 

In  this  appendix,  a threshold  setting  algorithm  will  be 
presented,  similar  (but  not  identical)  to  the  Bayes  decision 


algorithm.  First,  the  basic  decision  model  in  one  dimension 
will  be  reviewed. 

- Given  a measurement  sample  x - 

x 3 s n 
s 3 desired  signal 
n 3 noise 

- There  is  an  unknown  parameter  0 related  to  the  measure- 
ment. Example: 

Given  a pixel  containing  noise  and  "possible"  signal, 
as  in  Fig.  B-l(a)  - 


Measurement  samples  ■ x(m) 


Pixel  (m) 


The  unknown  parameter  ("event”)  0 


Given  the  conditional  PDF’s 


such  as  shown  in  Fig,  B-2 


-7« 'H'P'T-'*' TT--"‘  -'.rv  ”.' 


WWHJllWI1  - - ‘-^"W '■ 't  1 


Fig.  B- 2 


a = 


a 


In  order  to  determine  whether  the  signal  in  pixel  (m) 
is  Sq  or  s^,  the  following  definitions  have  to  be  made: 

- Define  the  following  decision  errors: 

Reject  when  correct 

P[X/91]dx 

Accept  when  false 

L P [X/9]  dx 
*1 

Define  the  following  costs: 

C^  ^ Cost  of  deciding  "Sq"  when  not  true 

» Cost  of  miss 


8 

8 


o 


when  not  true 


CpA  ^ Cost  of  deciding  "s^" 

* Cost  of  false  alarm. 

CIn  the  Bayes  solution  there  are  two  additional  cost 
terms  which  are  not  required  here.) 


Define  the  risks: 


CM-8  ■ Ro 


CFA“  ■ R1 


Given  the  probability  of  ’’event"  0Q  =*  gQ  ("event"  of 
no  target) 

Given  the  probability  of  "event"  9^  g,  = l-gQ  ("event" 
of  target  present) 

The  total  risk  can  be  found  by  combining  all  the  defini- 
tions above  and  is  given  by: 

R ■ VRo  * *i-Ri 

R " *0‘CMS  * Si *cpA  a <B-1  > 

* SO-CM-/-«THptXl0O!dx  * glCFA-C  PtXISjldx 

VTH 

dR 

Minimizing  R with  respect  to  V,^  ( ^ — = 0)  yields 

TH 

the  following  threshold  equation: 

Socmp[Vth/so]  • *1  cFAP[vTH/e1] 


(B-2  ) 


T\ 


u 


When  all  the  parameters  are  known,  we  can  solve  (B-2) 
for  the  threshold  level.  The  following  two  definitions  are 
useful : 


PlXlOxl 

A 


( B-3  ) 


likelihood  ratio 


A (X) 

goCM 
glCFA 

k ^ threshold  ratio 

Example 

Given  a measurement  X that  can  belong  either  to  XQ  or  X^ 
where 


( B-4  ) 


i 

Xo  - 

V 

N ( 0,  a 2 ) 
eo  - 0 

Xx  - N(y,a2) 

*i  • 91  " M 

N is  normal  PDF. 

Decide  whether  X belongs  to  XQ  or  X^ 
- Decision  method: 


p[xo/0>  • 7k 


PCXi/u]  - -~- 
L /Tt?o 


- X2/2o2 


2a" 


8nC 


o M 


K " 5T 
gl  r A 

CM»  CFA,  gQ,  g:  assumed  to  be  specified. 
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. — . — 


■«p,m  mu  ii  — 


Q 


The  likelihood  ratio  is: 


A C.X) 


-CX-u)2  /2o2 


1 T 

-XV2oZ 


- K 

X-V, 


TH 


The  threshold  level  is: 


TH 


7 + V ln  K 


(B-S) 


The  decision  algorithm: 


when  X > VTH  X belong  to 
when  X < VTH  X belong  to  XQ 


c.  Extension  to  Two  Dimensional 
Multivariable  Criteria 


Following  the  one  dimensional  case,  we  can 
define  the  signal  to  be  a vector  rather  than  a scalar. 


The  signal  is 
The  noise  is 


[sl,s2, * • ,SIJ 


N * tni,n2, * * ,nI^  * 


The  measurement  is  X ■ [x^  x2  ...xI]> 


xT  - sT  ♦ nt 


For  the  multivariable  normal  PDF,  the  Bayes 
solution  requires  that  the  vector  X will  be  filtered  first 
by  a matched  filter  and  then  compared  with  a given  threshold. 

- This  conclusion  can  be  demonstrated  as  follows: 

The  multivariable  normal  PDF  is: 


u 


261 


PtN)  ' C2«)i/2|RNN|1/2‘EXP['^NRNN  1nT) 

P(N)  = multivariate  normal  PDF 

Rnn  = covariance  matrix  of  the  noise 

= E[N^  N]  (assuming  E[N]  * 0) 

The  noise  vector  can  be  presented  as  follows: 


A point  target  can  be  expressed  as: 

SL  3 [0,0,...  g(m,n) ,0]  = S 
Sq  * [0,0, ...  0. . . 0]  * 0 


( B-6) 


The  likelihood  ratio  is  given  by: 


A(X) 


Exp[-|(X  - S1)Rnn~1(X  - S1)T] 
Exp[-^(X  - S0)Rnn_1(X  - Sq)T] 


( B'7 ) 


Taking  the  natural  log  of  (B-7)  will  yield  the 
required  conclusion: 


in  k - 4 (X  - S) RmN" 2(X  * S)T  . t X R«mXT 


x'rnn"1-s  ‘ C1 


( B-»  ) 


where 


C1  ■ 7SRNn'1sT 
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as  described  in  Fig.  B-3. 


1 - target 


Input  Matched 

vector  filter 


W - R 


NN 


Threshold  level 


TH 


■ In  k + c. 


APPENDIX  C 


G 


DERIVATION  OF  ADAPTIVE  FILTER  ALGORITHM* 


A.  ALGORITHM  DERIVATION 

At  a given  pixel,  the  output  of  the  filter  is 


y - X.T  W - WTX. 
J J J 


(C-l) 


Let  us  select  a desirable  reference  performance,  , 


which  we  seek  to  achieve  at  the  steady  state.  For  example, 
in  the  case  of  point  target  detection  (or  estimation) , we 
seek  to  achieve  the  best  estimate  of  a point  target  while 
suppressing  the  background  clutter  noise  as  much  as  possible. 


Let  us  define  the  error  at  pixel  location  j to  be 


e.  * d . -y.  * d . - W X . 
3 J 7J  3 ’3 


(C -2) 


It  is  the  purpose  of  the  adaptive  process  to  adjust  the 
weighting  coefficients  of  the  linear  adaptive  filter  to 


minimize  the  mean  square  error, 


The  derivation  of  the  adaptive  algorithm  is  started  by 
considering  the  k-th  step  of  adaptive  iteration.  The  mean 
square  error  is  given  by 
2 


d,2  - 2djXj\  • WkTXjXjTWk 


(C-3) 


J 3 

Its  statistical  expected  value  is  obtained  by  averaging  (C-3) 


over  an  ensemble  of  identical  adaptive  filters. 


*This  appendix  is  based  on  the  original  derivation  of 
B.  Widrow  [21,22]. 
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1 


u 


I 


Q 


Bt*/ W E[d  2]  -2E[djXjT]«tt*WkTE[Xj-XjT]Wlt 

(C-4) 

Let  us  define  a vector  P as  the  crosscorrelation  between 


the  desired  response  and  the  X-  vector. 


- E [dj-Xj1* ] » E[djX1^ldjX2j%..djXI  ] 


(C-S) 


The  input  correlation  matrix  Rxx  is  defined  in  terms  of 
the  ensemble  average 


R*RXX8  SfCjX/]  • 


(x,  x.  ) (X  . ^7  ) • • • 

j j i 

(x^  x . ) « • • 


(C-6) 


(Xj  xi  ) > 


* -J 


The  mean  square  error  5k  can  be  expressed  as 


E [d^2  ] - 2PT  Wk+  WkT  R Wj 


(C-7) 


It  is  a quadratic  function  of  the  coefficients.  Adjust- 
ing the  coefficients  involves  descending  along  a concave 
hyperparaboloidal  surface  with  the  objective  of  reaching  its 
minima.  Gradient  method  is  commonly  used  for  this  purpose. 
The  gradient  Vk  of  the  mean  square  error  function  at  W - Wk 
is  obtained  by  differentiating  (C-7) 

3E[e/] 


2P  ♦ 2R  • W, 


w ■ wk 


(C-  8) 


26S 


The  optimal  filter  W* , generally  called  the  Wiener  filter, 
is  obtained  by  setting  the  gradient  to  zero  and  is: 

(C-9  ) 

For  some  of  the  subsequent  analysis,  it  is  convenient  to 
express  the  mean  square  error  5^  (C-7)  and  the  gradient 
function  ( C-8  ) in  another  form  to  be  derived  as  follows: 

Substituting  (C-9)  into  (C-7)  will  yield: 

S,i„-  E (dj 2 1 - l‘*TP  (C-10) 

Recombining  (C-10)  with  (C-7)  and  (C-9  ) will  yield: 


where  - W* 

and  the  gradient  becomes 

7k  * 2RVk 


( C - 1 2) 

( C - 1 3) 


Since  R is  the  correlation  matrix,  it  is  positive  def- 
ite,  and  may  be  expressed  in  normal  form  as  follows: 

R - Q A Q'1  (C-14) 

where  A is  a diagonal  matrix  of  the  eigenvalues  of  R.  If  Q is 

- 1 T 

constructed  to  be  orthonormal,  then  Q * Q and  then  ^.^5) 
R'1  - Q A-1  Q"1  (C- 16) 

and  the  mean  square  error  may  be  expressed  as: 
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«k  ■ «min  *vkT<3A,5Tvk 


(C-17) 


o 


A new  set  of  coordinates  may  now  be  defined  as 
V - QTV  - Q*1V 
VT  « VTQ 


«k  - <„in  * VTaV 


(C-18) 

(C-19) 


( C-  20) 


This  transformation  projects  V into  prime  coordinates. 
Since  A is  diagonal,  the  prime  coordinate  must  comprise  the 
principal  axes  of  the  quadratic  mean  square  error  performance 
surface.  The  gradient  expressed  in  primed  coordinates  becomes 


2AV 


B.  THE  METHOD  OF  STEEPEST  DESCENT 


(C*  21) 


The  objective  of  the  adaptive  process  is  to  find  a 
solution  to  (C-9).  It  should  be  noted  that  (C-  9)  has  exactly 
the  same  form  as  the  equation  in  Chapter  III  for  designing 
the  spatial  MMSE  filter. 

In  that  chapter,  nonadaptive  filters  were  developed. 
Solution  of  (C-9)  required  a two  step  process  by  first 
calculating  the  statistical  properties  of  the  image  and  of 
the  targets,  then  followed  by  a solution  of  a set  of  linear 
equations . 


In  this  chapter,  adaptive  filters  are  being  developed. 

An  alternative  approach  is  used,  based  on  the  steepest  descent 
adaptive  method. 

The  adaption  in  this  method  starts  with  an  initial  value 
assigned  to  the  filter  -WQ.  The  gradient  of  the  mean  square 
error  is  measured  and  the  filter  coefficients  are  modified 
accordingly.  This  procedure,  when  repetitively  applied, 
causes  the  error  to  reduce  successively  until  the  filter 
approaches  the  optimal  value.  This  method  can  be  described 


by  the  following  relation. 


Wv  ♦ MOV.) 


(C*  22) 


where  u is  a parameter  (loop  gain)  that  controls  stability 
and  convergence  rate,  is  the  value  of  the  gradient  at  a 
point  on  the  error  surface  corresponding  to  W * W^. 

An  expression  for  is  given  by  (,013).  Substituting 
(013)  into  (022)  will  yield 

Vi  ■ wk  - 2“ R vk  <c-23> 

Subtracting  W*  from  both  sides  of  (0  23)  will  yield 

vk+i  * Vk  - 2uRVk  * (I  - 2UR)  Vk  (C- 24) 

Equation  (0  24)  is  a linear  homogenous  vector  difference 
equation  whose  solution  characterizes  the  dynamic  behavior 
of  the  adaptive  filter.  The  solution  to  (0  24)  is ; 


(I  - 2yR)*  V 


(0  25) 
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It  is 

stable  if 

lira  Cl  - 2yR)k  - 0 

(C-26) 

k-*» 

Since 

Cl  - 2yR)  - Q (I  - 2yA)Q‘1 

(C-27) 

and 

Cl  - 2yR)k  - Q(I  - 2yA)kQ*1 

(C-28) 

condition  (C-26)  will  be  satisfied  if 

lim(I  - 2yA)k  - 0 (C-29) 

k-*» 


Condition  (C-29)  will  be  satisfied  if 

1 1 - 2y  Ip  | < 1 (C-30) 

for  p * 1, 2. . . I 

or  -r— > y > 0 (C-31) 

( ) Araax 

where  * is  the  largest  eigenvalue  of  R 

IucLa  XX 

Equation  (C-31)  gives  the  stable  range  for  y. 

It  can  be  seen  that  in  primed  coordinates,  the  coefficient 
equation  given  by 

V'k+1  * (I  ' Z^v\  (c-32) 

with  the  solution 

V’k-  (I  - 2yA)kVQ  (C -33) 

For  the  p-th  coordinate  we  may  write 

Vk  ■ (1-  2uAP)k  vp0  (c'34) 

o 
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Eq.  (C-34)  represents  a geometrical  progression  for  v 


pk 


starting  from  the  initial  condition  v ' 

po 


The  geometric  ratio  of  the  p coordinate  is: 


rp  " U-  2uip)  . 


(C- 35) 


Since  we  prefer  to  talk  usually  in  terms  of  exponential 
progression,  we  can  fit  an  exponential  envelope  to  (C-33) 
with  time  constant,  x . If  the  unit  of  time  is  one  itera- 
tion cycle,  then 


rp  = exp('1/xp) 


(C-36) 


In  practical  applications,  p is  selected  so  that  xp  >>  l 
and  (C-36)  can  be  approximated  by  the  first  two  terms  only. 
Combining  (C-36)  and  (C-35)  gives  the  formula  for  the  p-th 
time  constant 


r * 1 - 2V  X . l - JL 

P P tp 

x l 

P 2u  Xp 


C C - 3 7) 


Therefore,  we  can  summarize  that  the  transients  in  the 
coefficients  of  "filter  V"  are  geometric  sequences  with  an 
approximate  time  constant,  x . In  the  filter  W (not  in 
prime  coordinates)  the  transients  will  consist  of  sum  of 
geometric  sequences,  with  the  total  number  of  time  constants 
typically  equal  to  the  number  of  coefficients. 


Similarly,  while  the  coefficients  are  varying,  the  mean 
square  error  (MSE)  varies  as  well.  Substitution  of  (C-33  ) 


into  (C-20)  will  yield  the  "learning  curve"  - the  MSE  as  a 


function  of  k: 


«k  ' W V0'T(I-2„A)21tA-V0' 


( C-38  ) 


As  long  as  condition  (C-34  ) and  (C-31 ) are  met,  the  adaptive 
process  will  converge  on  the  minimum  point  of  the  MSE  surface. 


«k  * 'min 


( C - 39) 


Here  again,  the  relaxation  process  is  a sum  of  geometric 
sequences  where  the  p-th  mode  has  a geometric  ratio  of  (1  - 2uXp)fc 
resulting  in  a time  constant 

'ft...  - A-  - (c-«) 


To  accomplish  the  coefficient's  adaptation,  we  have  to 
measure  or  estimate  the  gradient  at  each  iteration.  Reference 
[ 21]  suggested  two  methods  to  obtain  the  gradient  estimate. 
The  first  method  uses  differentiation  and  requires  that  finite 
perturbations  be  made  on  the  filter  coefficients.  The 
second,  so-called  LMS  method,  obtains  gradient  estimates 
directly  and  without  perturbing  the  nominal  coefficients 
adjustment. 

In  this  work,  the  second  method  was  selected,  based  on 
two  reasons. 


V 


Practical  implementation  and  utilization  of  this  method 
is  simpler,  compared  to  the  other  alternative. 

Reference  [ 21  J demonstrated  the  superiority  of  the  LMS 
algorithm  with  regard  to  convergence  time  and  mean  square 
error,  compared  to  the  other  candidate. 


C . THE  LMS  ADAPTATION  ALGORITHM 

The  LMS  algorithm  is  an  implementation  of  the  steepest 
descent  method  that  employs  an  efficient  gradient  estimation 
technique.  This  method  was  found  applicable  to  the  two  di- 
mensional filtering  configuration  presented  earlier  in  Fig. 
7-3. 

1.  Gradient  Estimation,  Convergence  and  Time  Constants 
The  error,  ej  , of  a filter  such  as  shown  in  Fig.  7-2 
is  given  by  (02).  A gradient  estimate  may  be  obtained  by 
squaring  the  single  value  of  Ej  and  differentiating  it  as  if 
it  were  the  mean  square  error: 


de. 


pi 

3Wj 


since  e.  » d.  - 1TX.  and  t— J 
J J J dW 


= -2e.X. 
J J 


(C-41) 


Substituting  (C-41)  into  (C-42)  will  yield  the  LMS  algorithm 


Vi  - wj  + 2*ejxj 


(C-42) 


where  the  index  k is  replaced  by  j since  we  perform  an  adap- 
tation step  for  each  new  input  vector,  i.e.,  a new  set  of 
data  samples. 


The  gradient  estimate  of  (C - 4 1)  may  be  implemented  in  a 
practical  system  without  further  squaring  or  averaging  and 
is  simple  and  elegant.  All  components  of  the  gradient  vector 
are  obtained  from  one  input  data  set  X.  Since  the  estimate 
is  obtained  without  averaging,  it  contains  a large  component 
of  noise.  The  noise,  however,  is  averaged  and  attenuated  by 
the  adaptive  process,  which  acts  as  a low  pass  filter  in  this 
respect. 

It  is  important  to  note  also  that  for  a fixed  value  of 
W,  the  estimate  is  unbiased,  which  can  be  shown  as  follows: 

E [7j]  * ^Ete.Xj]  - -2E[djXj  - XjxT  W]  (C-43) 

From  (C-8  ),  this  expression  can  be  rewritten  as 

E[7j]  » - 2 (P- RW)  - 7 ( C - 4 4) 

recalling  that  v is  approaching  zero  at  steady  state. 

2 . Convergence  of  the  Mean  of  Filter  Coefficients 

Let  us  now  show  that  the  mean  value  of  the  filter 
coefficient  instead  converges  to  a steady  state  when  the  LMS 
algorithm  is  implemented.  Taking  the  expected  value  of 
(C-42)>  we  obtain  the  following: 

E[Wj+iJ  - E [Wj  ] - 2UE  {Xj[dj  -X/  Wj]}  = 

■ [I  + 2yR  ] *£[W  ] - 2uP  (C-45) 

In  obtaining  (C-45),  we  assumed  that  W and  X are 
uncorrelated . It  will  be  shown  later  that  proper  selection 


of  the  adaptation  loop  gain  w will  cause  the  filter  coeffi- 
cients to  vary  very  slowly  compared  with  the  value  of  the 
noise  (X)  correlation  coefficients. 

E [xT  w]  = E [x^J  • W 

where  W is  considered  almost  as  a constant  relative  to 
F[xT] . Under  these  assumptions,  E[xT*w]  a E[xT]*E[w],  i.e., 

X and  W can  be  considered  uncorrelated. 

Referring  back  to  equation  (C-45),  with  an  initial 
filter  coefficient,  WQ,  j + 1 iterations  of  equation  (C-45) 
yield 

E[wj  + 1]-  [I  + 2uRxx]  'i  + lwo  ' 2yJ0[I  * 2y*RxxJ  lp  (C  - 4 6 ) 

Eq.  (C-46)  may  be  put  in  diagonal  form  by  using  the  normal 
expansion  of  R , that  is, 

Rxx  Q"1  A Q 

The  eigenvalues  are  all  positive,  since  R is  positive 

XX 

definite.  Equation  (C-46)  may  now  be  expressed  as 

E(w.  + 1]  - [I  ♦ 2UQ*1  AQ]  j + 1W  - i (1*2  Q'1  A Q]  iP  - 
J ° i*o 

« Q"1[I  + 2uA]^+1Q*W  - 2uQ* 1 . Z [I  ♦ 2u  A]iQ*PrC.a^ 

° i*o  *' ) 

Consider  the  diagonal  matrix  [I  * 2u  A ] . As  long  as  its  diagonal 
terms  are  all  of  magnitude  less  than  unity 

j + l 

lim[ I * 2pA] J 0 

j — 

274 


and  the  first  term  of  CC- 47)  vanishes  as  j-*» . 

The  second  term  in  (C-47)  converges  to  a non- zero 

limit.  The  summation  factor  - 

Z [I  ♦ 2MA]i 
i«o 

j i 1-1 

becomes  lim  z [I  ♦ 2yA]  - - y-  A 

jfoo  i*o 

where  the  formula  for  the  sum  of  the  geometric  series  has 
been  used,  that  is: 


Z (1  ♦ 2ux  - 
i-o  H 


l~(UTu\p) 


-1 


Thus,  on  the  limit,  equation  (7-49)  becomes 
lim  E[wj+1]  - Q_1AQ-P  - RXX.P 

Comparison  of  this  result  with  (C-9  ) shows  that  as  the 
number  of  iterations  increases  without  limit,  the  expected 
value  of  the  filter  coefficient  converges  to  the  coefficients 
of  the  Wiener  filter. 

The  convergence  is  assured  if,  and  only  if,  y is  set 
within  certain  bounds.  Since  the  diagonal  terms  of  (I  «■  2yA] 
must  all  have  magnitude  less  than  unity,  and  since  all  eigen- 
values in  A are  positive,  the  bounds,  on  y,  are  given  by 

i1*KJi  < 1 
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where  xmax  is  the  maximum  eigenvalue  of  Rxx>  This  convergence 
condition  can  be  related  to  the  total  input  signal  power  as 
follows : 

Xmax  < trace  Rxx 


^ T*  r V T V 1 _ r*  r»  r ~ 2 1 A 


(C  -48) 


trace  [R  ] * E[X.  X.]  ■ z E[x.  ] ■ total  input 
xx  ' i»l  1 power. 

Therefore,  the  bounds  for  satisfactory  convergence  are 


-1 

i — r 

2 E[x/  ] 

i-1  1 


< u < 0 


In  practical  applications,  when  precise  adaptation  is  required, 
q is  usually  selected  such  that 

(C-49) 


3 . The  Noise  of  Gradient  Estimation 

Let  it  be  assumed  that  the  adaptive  process,  using  a 
small  loop  gain  u,  has  converged  to  a steady  state  near  the 
minimum  of  the  MSE  (£).  The  gradient  estimation  noise  of  the 
LMS  algorithm  at  the  minimum,  where  the  true  gradient  is  zero, 
is  the  gradient  estimate  itself: 

(C  - 50 ) 


since 


where 


Nj 


7j 


7j 


-V; 


7j  * Nj 

the  true  gradient 


Nj  ■ gradient  noise  vector. 
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The  covariance  of  this  noise  is  given  by 


cov[N.]  - ECNjNj1]  " 4E[ej2xjx.T] 


(C*  51) 


It  is  known  from  Wiener  filter  theory  that  when  « W*  [the 
optimal  filter]  the  error  is  uncorrelated  with  the  input 
vector  x j . If  one  assumes  that  and  Xj  are  Gaussian,  they 
will  be  independent,  as  well,  at  the  minimum.  Under  these 


conditions  ( C - 51)  becomes 


cov[Nj]  - 4E[ej2]-E(XjXjT]  > 45min  R]tx 


In  primed  coordinates,  the  covariance  is 

cov[N ] - Q* 1 cov[Nj  ]Q  - 4^minA 
4.  Noise  in  Filter  Coefficients 


(C*  52) 


( C- 53) 


Adaptation  based  on  noisy  gradient  estimates  results 
in  noise  in  the  filter  coefficients.  The  method  of  steepest 
descent  with  ideal  gradients  is  represented  by  (C-29).  With 
estimated  gradients,  this  equation  may  be  rewritten  as: 

vj+1  * vj  + uc-v  ■ vj  + c-^j  - V (C*54) 

* A 

where  the  estimated  gradient  is  * 7j  + Nj . 

Substituting  (C-13)  and  combining  terms  yields 


Vi  * y • 2»Rxx)vj  - unj 


(C-55) 


This  is  a first  order  difference  equation  with  a stochastic 
driving  function  of  -yNj . Projection  into  primed  coordinates 


may  be  accomplished  by  premultiplying  both  sides  of  (C-55) 
by  Q'1. 

V'j  + 1 - (1  - ZuAjV'j  - uNA  (C-56  ) 

In  steady  state,  after  initial  adaptive  transients  have  died 
out,  Vj'  undergoes  a stationary  random  process  in  response  to 
the  stationary  driving  function,  -yNy  . Since  there  is  no 
cross  coupling  between  terms  and  the  components  of  Ny  are 
mutually  uncorrelated,  the  components  of  vy  will  also  be 
mutually  uncorrelated,  and  the  covariance  matrix  of  NV  will 
be  diagonal.  To  find  the  matrix,  one  first  multiplies  both 
sides  of  (c-56)  by  their  transposes. 

V’j+lVlT*  Cl  * 2WA)VyvyT(I  - 2UA)  ♦u2N'jNj’T 

- u(I  * 2uA)V.'N'.  T - - 2yA) 

(C-57) 

Taking  expected  values  of  both  sides  yields 


cov[V’j]  - (I  - 2yA)cov[Vj']  (I  - 2yA)  ♦ y2cov[Nj'J 

( C-  S8  ) 

(Note  that  Vj ' Nj ' are  uncorrelated  since  Vj  is  affected  only 
by  gradient  noise  from  previous  adaptive  cycles.) 

Combining  terms  further  yields: 

COV[Vj  * ] - y2(4yA“  4y2  A2)  " lCOV  [N  ' j ] (C-59) 

In  practical  applications,  when  y is  small, 
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G 


y A <<  I 

Neglecting  the  squared  terms  in  (C-59) 
cov[Vj  ^ A"1cov[Nj'  ] 


Combining  (C-59  ) with  (C-52),  one  may  write 


cov[V'.]  - J A'  C45minA)  = yCmin  I 


(C-60  ) 


The  covariance  of  Vj  can  be  obtained  from  (C-60)  by  using 
CC-16  ) and  (C-18  ) • 

COV^]  . E[QVA  V.'  T Q'1]  ■ Q*uEmin  I Q"1  - P5min-I 

( C-  61) 

5 . Misadjustment 

Without  noise  in  the  weighting  vector,  adaptation  by 

the  method  of  steepest  descent  would  converge  to  a steady- 

state  solution  at  the  minimum  point  of  the  MSE  surface.  The 

MSE  and  the  minimum  will  be  £ . . Noise  on  the  weighting 

min 

vector,  however,  tends  to  cause  the  steady-state  solution  to 

vary  randomly  about  the  minimum.  The  result  is  an  excess  mean 

square  error,  a mean  square  that  is  greater  than  5m^n- 

An  expression  for  mean  square  error  in  terms  of  V'  is 

given  by  (C-20),  where  the  excess  mean  square  error  is 
T 

V. ' AVy  , The  average  excess  mean  square  error  is 
H[Vi’TAVi']  - l A„E[v„  1 )2]  ■ U5min  E Xp 


where,  according  to  (C-6I), 
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B[(vp'  )2]  - u5min  for  all  P 

A useful  parameter  in  the  design  of  adaptive  processes 
is  the  misadjustment  M,  which  is  defined  as  the  average  excess 
mean  square  error  divided  by  the  minimum  mean  square  error. 
m i E[V’.TAV.]] 

M j 2— J L C- 62) 

^ m i n 


The  misadjustment  is  a dimensionless  measure  of  the  difference 
between  adaptive  performance  and  optimal  Wiener  performance 
as  a result  of  gradient  noise.  The  misadjustment  is  thus 


given  by 


M * y tr  R 


(C - 63) 


This  useful  formula  may  be  re- expressed  in  a manner  that 
allows  one  to  perceive  the  relationship  between  misadjustment 
and  rate  of  adaptation.  According  to  (7-42)  one  may  write 

i I -i  T -l 


tr 


2 i 

p*l  n p av 

^ ^mse  ^mse 


(C-64) 


The  misadjustment  may  thus  be  written 

M • j (^-i— ) (C'65) 

1 p av 
Hmse 

where  I is  the  number  of  filter  coefficients  and  t is 

^mse 

the  MSE  time  constant,  related  to  the  learning  curve.  When  the 


eigenvalues  are  equal, 


m * 


C C - 66) 


r 


i 


( ) 


c 


Since  trace  Rxx  is  the  total  power  of  the  input  vector  X, 


which  is  generally  known,  one  can  use  (C-63)  in  choosing  a 
value  of  that  will  produce  a desired  value  of  M._  Combin- 
ing (C-66)  with  (C-63)  will  yield  a general  formula  for  the 
time  constant  of  the  learning  curve  with  equal  eigenvalues. 


mse  4y  tr  R. 


(C- 67) 


XX 


This  formula  is  also  a good  approximation  in  many  cases  when 
the  eigenvalues  of  Rxx  are  unequal. 
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